kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
rel
TensorRT-LLMs/tensorrt_llm/llmapi
History
Kaiyu Xie 3c0462002c
TensorRT-LLM v0.18 release (#3231)
2025-04-02 17:01:16 +08:00
..
__init__.py TensorRT-LLM v0.16 Release 2024-12-24 15:58:43 +08:00
_perf_evaluator.py TensorRT-LLM v0.18 release (#3231) 2025-04-02 17:01:16 +08:00
build_cache.py TensorRT-LLM Release 0.15.0 (#2529) 2024-12-04 13:44:56 +08:00
llm_utils.py open source 09df54c0cc99354a60bbc0303e3e8ea33a96bef0 (#2725) 2025-02-11 02:21:51 +00:00
llm.py open source 09df54c0cc99354a60bbc0303e3e8ea33a96bef0 (#2725) 2025-02-11 02:21:51 +00:00
mgmn_worker_node.py TensorRT-LLM Release 0.15.0 (#2529) 2024-12-04 13:44:56 +08:00
mpi_session.py TensorRT-LLM v0.16 Release 2024-12-24 15:58:43 +08:00
tokenizer.py TensorRT-LLM v0.16 Release 2024-12-24 15:58:43 +08:00
tracer.py TensorRT-LLM Release 0.15.0 (#2529) 2024-12-04 13:44:56 +08:00
trtllm-llmapi-launch TensorRT-LLM Release 0.15.0 (#2529) 2024-12-04 13:44:56 +08:00
utils.py open source 09df54c0cc99354a60bbc0303e3e8ea33a96bef0 (#2725) 2025-02-11 02:21:51 +00:00