mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced 2026-01-14 06:27:45 +08:00
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
ace2b6917b
* Add 0.18.2 Signed-off-by: Kaiyu Xie <26294424+kaiyux@users.noreply.github.com> * Remove doctree Signed-off-by: Kaiyu Xie <26294424+kaiyux@users.noreply.github.com> * Add 0.19.0rc0 Signed-off-by: Kaiyu Xie <26294424+kaiyux@users.noreply.github.com> * Add 0.20.0rc0 Signed-off-by: Kaiyu Xie <26294424+kaiyux@users.noreply.github.com> * Add latest Signed-off-by: Kaiyu Xie <26294424+kaiyux@users.noreply.github.com> --------- Signed-off-by: Kaiyu Xie <26294424+kaiyux@users.noreply.github.com> |
||
|---|---|---|
| _cpp_gen | ||
| _downloads | ||
| _images | ||
| _modules | ||
| _sources | ||
| _static | ||
| 0.18.2 | ||
| 0.19.0rc0 | ||
| 0.20.0rc0 | ||
| advanced | ||
| architecture | ||
| blogs | ||
| commands | ||
| installation | ||
| latest | ||
| llm-api | ||
| llm-api-examples | ||
| performance | ||
| python-api | ||
| reference | ||
| torch | ||
| .nojekyll | ||
| genindex.html | ||
| index.html | ||
| key-features.html | ||
| objects.inv | ||
| overview.html | ||
| py-modindex.html | ||
| quick-start-guide.html | ||
| release-notes.html | ||
| search.html | ||
| searchindex.js | ||
| torch.html | ||