kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
50 Commits 25 Branches 59 Tags 2.1 GiB
Python 48.8%
C++ 38.5%
Cuda 10.8%
Groovy 0.7%
CMake 0.5%
Other 0.5%
ab9a58dfce
Go to file
Kaiyu Xie ab9a58dfce Update GitHub pages to v0.20.0rc2
2025-05-13 09:02:21 +00:00
_cpp_gen Fix main page 2025-04-26 05:56:13 +00:00
_downloads Fix main page 2025-04-26 05:56:13 +00:00
_images Fix main page 2025-04-26 05:56:13 +00:00
_modules Fix main page 2025-04-26 05:56:13 +00:00
_sources Fix main page 2025-04-26 05:56:13 +00:00
_static Revert "Update switcher.json" 2025-05-13 00:46:40 -07:00
0.18.2 use softlink in switcher.json 2025-05-12 01:04:36 -07:00
0.19.0 use softlink in switcher.json 2025-05-12 01:04:36 -07:00
0.19.0rc0 use softlink in switcher.json 2025-05-12 01:04:36 -07:00
0.20.0rc0 use softlink in switcher.json 2025-05-12 01:04:36 -07:00
0.20.0rc2 Update GitHub pages to v0.20.0rc2 2025-05-13 09:02:21 +00:00
advanced Fix main page 2025-04-26 05:56:13 +00:00
architecture Fix main page 2025-04-26 05:56:13 +00:00
blogs Fix main page 2025-04-26 05:56:13 +00:00
commands Fix main page 2025-04-26 05:56:13 +00:00
dev-on-cloud Fix main page 2025-04-26 05:56:13 +00:00
examples Fix main page 2025-04-26 05:56:13 +00:00
installation Fix main page 2025-04-26 05:56:13 +00:00
latest use softlink in switcher.json 2025-05-12 01:04:36 -07:00
llm-api Fix main page 2025-04-26 05:56:13 +00:00
llm-api-examples Fix main page 2025-04-26 05:56:13 +00:00
performance Fix main page 2025-04-26 05:56:13 +00:00
python-api Fix main page 2025-04-26 05:56:13 +00:00
reference Fix main page 2025-04-26 05:56:13 +00:00
torch Fix main page 2025-04-26 05:56:13 +00:00
.nojekyll update gh-pages (#3403) 2025-04-09 14:14:17 +08:00
genindex.html Fix main page 2025-04-26 05:56:13 +00:00
index.html Fix main page 2025-04-26 05:56:13 +00:00
key-features.html Fix main page 2025-04-26 05:56:13 +00:00
objects.inv Fix main page 2025-04-26 05:56:13 +00:00
overview.html Fix main page 2025-04-26 05:56:13 +00:00
py-modindex.html Fix main page 2025-04-26 05:56:13 +00:00
quick-start-guide.html Fix main page 2025-04-26 05:56:13 +00:00
release-notes.html Fix main page 2025-04-26 05:56:13 +00:00
search.html Fix main page 2025-04-26 05:56:13 +00:00
searchindex.js Fix main page 2025-04-26 05:56:13 +00:00
switcher.json Update 0.19 (#4193) 2025-05-09 22:47:22 +08:00
torch.html Fix main page 2025-04-26 05:56:13 +00:00