kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
27 Commits 25 Branches 59 Tags 2.1 GiB
Python 48.8%
C++ 38.5%
Cuda 10.8%
Groovy 0.7%
CMake 0.5%
Other 0.5%
305ff638ef
Go to file
Kaiyu Xie 305ff638ef
Revert "doc:fix llm api reference blank issue. (#2669)" (#2700) 
This reverts commit 42d0585493.
2025-01-16 21:53:14 +08:00
_cpp_gen Revert "doc:fix llm api reference blank issue. (#2669)" (#2700) 2025-01-16 21:53:14 +08:00
_downloads Update gh-pages (#2646) 2025-01-02 17:53:20 +08:00
_images Update gh-pages (#2646) 2025-01-02 17:53:20 +08:00
_modules Revert "doc:fix llm api reference blank issue. (#2669)" (#2700) 2025-01-16 21:53:14 +08:00
_sources Revert "doc:fix llm api reference blank issue. (#2669)" (#2700) 2025-01-16 21:53:14 +08:00
_static Revert "doc:fix llm api reference blank issue. (#2669)" (#2700) 2025-01-16 21:53:14 +08:00
advanced Revert "doc:fix llm api reference blank issue. (#2669)" (#2700) 2025-01-16 21:53:14 +08:00
architecture Revert "doc:fix llm api reference blank issue. (#2669)" (#2700) 2025-01-16 21:53:14 +08:00
blogs Revert "doc:fix llm api reference blank issue. (#2669)" (#2700) 2025-01-16 21:53:14 +08:00
commands Revert "doc:fix llm api reference blank issue. (#2669)" (#2700) 2025-01-16 21:53:14 +08:00
installation Revert "doc:fix llm api reference blank issue. (#2669)" (#2700) 2025-01-16 21:53:14 +08:00
llm-api Revert "doc:fix llm api reference blank issue. (#2669)" (#2700) 2025-01-16 21:53:14 +08:00
llm-api-examples Revert "doc:fix llm api reference blank issue. (#2669)" (#2700) 2025-01-16 21:53:14 +08:00
performance Revert "doc:fix llm api reference blank issue. (#2669)" (#2700) 2025-01-16 21:53:14 +08:00
python-api Revert "doc:fix llm api reference blank issue. (#2669)" (#2700) 2025-01-16 21:53:14 +08:00
reference Revert "doc:fix llm api reference blank issue. (#2669)" (#2700) 2025-01-16 21:53:14 +08:00
.nojekyll gh-pages for release/0.5.0 2023-10-19 12:25:48 +00:00
genindex.html Revert "doc:fix llm api reference blank issue. (#2669)" (#2700) 2025-01-16 21:53:14 +08:00
index.html Revert "doc:fix llm api reference blank issue. (#2669)" (#2700) 2025-01-16 21:53:14 +08:00
key-features.html Revert "doc:fix llm api reference blank issue. (#2669)" (#2700) 2025-01-16 21:53:14 +08:00
objects.inv Revert "doc:fix llm api reference blank issue. (#2669)" (#2700) 2025-01-16 21:53:14 +08:00
overview.html Revert "doc:fix llm api reference blank issue. (#2669)" (#2700) 2025-01-16 21:53:14 +08:00
py-modindex.html Revert "doc:fix llm api reference blank issue. (#2669)" (#2700) 2025-01-16 21:53:14 +08:00
quick-start-guide.html Revert "doc:fix llm api reference blank issue. (#2669)" (#2700) 2025-01-16 21:53:14 +08:00
release-notes.html Revert "doc:fix llm api reference blank issue. (#2669)" (#2700) 2025-01-16 21:53:14 +08:00
search.html Revert "doc:fix llm api reference blank issue. (#2669)" (#2700) 2025-01-16 21:53:14 +08:00
searchindex.js Revert "doc:fix llm api reference blank issue. (#2669)" (#2700) 2025-01-16 21:53:14 +08:00