TensorRT-LLMs/tensorrt_llm/llmapi
Erin 812bc8c954
[TRTLLM-8513][feat] Add back worker extension (#8482)
Signed-off-by: Erin Ho <14718778+hchings@users.noreply.github.com>
2025-10-24 20:30:28 -04:00
..
__init__.py [TRTLLM-8535][feat] Support DeepSeek V3.2 with FP8 + BF16 KV cache/NVFP4 + BF16 KV cache (#8405) 2025-10-24 13:40:41 -04:00
build_cache.py [TRTLLM-8682][chore] Remove auto_parallel module (#8329) 2025-10-22 20:53:08 -04:00
disagg_utils.py [TRTLLM-7843][feat] implement disagg cluster auto-scaling (#8215) 2025-10-21 17:25:07 -04:00
llm_args.py [TRTLLM-8513][feat] Add back worker extension (#8482) 2025-10-24 20:30:28 -04:00
llm_utils.py [TRTLLM-8682][chore] Remove auto_parallel module (#8329) 2025-10-22 20:53:08 -04:00
llm.py [TRTLLM-8714][fix] update create_input_processor to handle custom checkpoint format (#7811) 2025-10-23 10:27:56 +02:00
mgmn_leader_node.py [None][chore] replace print_colored_debug with logger_debug (#8417) 2025-10-22 17:54:38 +08:00
mgmn_worker_node.py Update TensorRT-LLM (#2333) 2024-10-15 15:28:40 +08:00
mm_encoder.py [TRTLLM-8714][fix] update create_input_processor to handle custom checkpoint format (#7811) 2025-10-23 10:27:56 +02:00
mpi_session.py [None][chore] replace print_colored_debug with logger_debug (#8417) 2025-10-22 17:54:38 +08:00
reasoning_parser.py [None][feat] Support Qwen3 reasoning parser (#8000) 2025-10-21 14:08:39 +08:00
tokenizer.py [None] [feat] Add Tencent HunYuanMoEV1 model support (#5521) 2025-08-15 06:56:44 +08:00
tracer.py Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
trtllm-llmapi-launch [TRTLLM-6295][test] Exit as early as possible and propagate exit status correctly for multi-node testing (#7739) 2025-09-16 09:59:18 +08:00
utils.py [None][chore] replace print_colored_debug with logger_debug (#8417) 2025-10-22 17:54:38 +08:00