TensorRT-LLMs/tensorrt_llm/llmapi
Guoming Zhang cabda243f1
[TRTLLM-5930][doc] 1.0 Documentation. (#6696)
Signed-off-by: nv-guomingz <137257613+nv-guomingz@users.noreply.github.com>
2025-09-04 05:29:43 -04:00
..
__init__.py [TRTLLM-5930][doc] 1.0 Documentation. (#6696) 2025-09-04 05:29:43 -04:00
build_cache.py Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
disagg_utils.py [Disaggregated] Add retry knobs and handling (#5808) 2025-07-19 07:27:59 +08:00
llm_args.py [TRTLLM-7030][fix] BREAKING CHANGE: Mismatch between docs and actual commands (#7191) 2025-08-25 20:21:43 +08:00
llm_utils.py [https://nvbugs/5448754][fix] Download HF model for all nodes. (#6824) 2025-09-01 16:00:43 +08:00
llm.py [TRTLLM-4721][test] Add qa test for llm-api (#6727) 2025-08-11 08:03:16 +08:00
mgmn_leader_node.py fix[nvbug5298640]: trtllm-llmapi-launch multiple LLM instances (#4727) 2025-06-19 06:13:53 +08:00
mgmn_worker_node.py Update TensorRT-LLM (#2333) 2024-10-15 15:28:40 +08:00
mpi_session.py [https://nvbugs/5451296][fix] zmq nonblock bug with retry (#7019) 2025-08-21 08:34:46 +08:00
reasoning_parser.py feat: add deepseek-r1 reasoning parser to trtllm-serve (#3354) 2025-05-06 08:13:04 +08:00
tokenizer.py [None][fix] fix kimi k2 serving and add test for Kimi-K2 (#6589) 2025-08-05 18:05:33 +08:00
tracer.py Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
trtllm-llmapi-launch fix[nvbug5298640]: trtllm-llmapi-launch multiple LLM instances (#4727) 2025-06-19 06:13:53 +08:00
utils.py [None][doc] add status labels to LLM class's api reference (#6899) 2025-08-19 21:50:04 -04:00