TensorRT-LLMs/tensorrt_llm/llmapi
Iman Tabrizian 82276167e6
[None][feat] Add NCCL Symmetric Integration for All Reduce (#4500)
Signed-off-by: Iman Tabrizian <10105175+tabrizian@users.noreply.github.com>
2025-08-07 17:28:14 -07:00
..
__init__.py [None][opt] ADP schedule balance optimization (#6061) 2025-08-06 09:38:02 +08:00
build_cache.py Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
disagg_utils.py [Disaggregated] Add retry knobs and handling (#5808) 2025-07-19 07:27:59 +08:00
llm_args.py [None][feat] Add NCCL Symmetric Integration for All Reduce (#4500) 2025-08-07 17:28:14 -07:00
llm_utils.py [None] [feat] Add model gpt-oss (#6645) 2025-08-07 03:04:18 -04:00
llm.py [None][feat] Clean up ngram auto mode, add max_concurrency to configs (#6676) 2025-08-07 12:51:47 -04:00
mgmn_leader_node.py fix[nvbug5298640]: trtllm-llmapi-launch multiple LLM instances (#4727) 2025-06-19 06:13:53 +08:00
mgmn_worker_node.py Update TensorRT-LLM (#2333) 2024-10-15 15:28:40 +08:00
mpi_session.py fix[nvbug5298640]: trtllm-llmapi-launch multiple LLM instances (#4727) 2025-06-19 06:13:53 +08:00
reasoning_parser.py feat: add deepseek-r1 reasoning parser to trtllm-serve (#3354) 2025-05-06 08:13:04 +08:00
tokenizer.py [None] [feat] Add model gpt-oss (#6645) 2025-08-07 03:04:18 -04:00
tracer.py Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
trtllm-llmapi-launch fix[nvbug5298640]: trtllm-llmapi-launch multiple LLM instances (#4727) 2025-06-19 06:13:53 +08:00
utils.py [TRTLLM-5061] chore: add status tags to LLM API reference (#5707) 2025-07-28 15:57:07 +08:00