TensorRT-LLMs/tensorrt_llm/llmapi
YueWeng cc336c4abd
[TRTLLM-8160][feat] Add draft token tree runtime on CDL (#8586)
Signed-off-by: Yue Weng <25103990+yweng0828@users.noreply.github.com>
2025-11-25 09:40:55 -05:00
..
__init__.py [TRTLLM-8535][feat] Support DeepSeek V3.2 with FP8 + BF16 KV cache/NVFP4 + BF16 KV cache (#8405) 2025-10-24 13:40:41 -04:00
build_cache.py [TRTLLM-8684][chore] Migrate BuildConfig to Pydantic, add a Python wrapper for KVCacheType enum (#8330) 2025-10-28 09:17:26 -07:00
disagg_utils.py [None][feat] Add opentelemetry tracing (#5897) 2025-10-27 18:51:07 +08:00
kv_cache_type.py [TRTLLM-8684][chore] Migrate BuildConfig to Pydantic, add a Python wrapper for KVCacheType enum (#8330) 2025-10-28 09:17:26 -07:00
llm_args.py [TRTLLM-8160][feat] Add draft token tree runtime on CDL (#8586) 2025-11-25 09:40:55 -05:00
llm_utils.py [https://nvbugs/5558117][fix] Allow per-layer quant config from hf_quant_config.json (#8617) 2025-10-31 04:41:44 -07:00
llm.py [TRTLLM-9191][feat] support out-of-tree models in trtllm-serve (#9269) 2025-11-21 04:23:47 -08:00
mgmn_leader_node.py [None][chore] replace print_colored_debug with logger_debug (#8417) 2025-10-22 17:54:38 +08:00
mgmn_worker_node.py Update TensorRT-LLM (#2333) 2024-10-15 15:28:40 +08:00
mm_encoder.py [TRTLLM-8714][fix] update create_input_processor to handle custom checkpoint format (#7811) 2025-10-23 10:27:56 +02:00
mpi_session.py [https://nvbugs/5437384][test] CHERRY-PICK: fix trtllm-llmapi-launch multi tests (#8567) 2025-11-01 06:49:33 -07:00
reasoning_parser.py [None][feat] Support Qwen3 reasoning parser (#8000) 2025-10-21 14:08:39 +08:00
rlhf_utils.py [None][chore] Relocate rlhf_utils.py (#8938) 2025-11-10 19:03:23 -08:00
tokenizer.py [None] [feat] Add Tencent HunYuanMoEV1 model support (#5521) 2025-08-15 06:56:44 +08:00
tracer.py Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
tracing.py [None][feat] Add opentelemetry tracing (#5897) 2025-10-27 18:51:07 +08:00
trtllm-llmapi-launch [https://nvbugs/5569754][fix] trtllm-llmapi-launch port conflict (#8582) 2025-11-20 12:43:13 -05:00
utils.py [https://nvbugs/5527655][feat] Add NUMA-aware CPU affinity autoconfig (#8805) 2025-11-06 11:59:46 -08:00