TensorRT-LLMs/tensorrt_llm/llmapi
Dmitry Barsukoff ea49afdf0b
[None][fix] AttributeError with return_perf_metrics on tensorrt backend (#10662)
Signed-off-by: Dmitry Barsukoff <riZZZhik@gmail.com>
Co-authored-by: Kanghwan <861393+karljang@users.noreply.github.com>
2026-02-02 08:41:15 +08:00
..
__init__.py [TRTC-122][feat] Eagle3 Specdec UX improvements (#10124) 2026-01-22 07:24:11 -08:00
build_cache.py [TRTLLM-8684][chore] Migrate BuildConfig to Pydantic, add a Python wrapper for KVCacheType enum (#8330) 2025-10-28 09:17:26 -07:00
disagg_utils.py [TRTLLM-10059][feat] Use global unique id as disagg request id (#10187) 2026-01-21 22:52:34 -05:00
kv_cache_type.py [TRTLLM-8684][chore] Migrate BuildConfig to Pydantic, add a Python wrapper for KVCacheType enum (#8330) 2025-10-28 09:17:26 -07:00
llm_args.py [None][fix] AttributeError with return_perf_metrics on tensorrt backend (#10662) 2026-02-02 08:41:15 +08:00
llm_utils.py [TRTLLM-9771][feat] Allow overriding quantization configs (#11062) 2026-01-31 10:48:51 -05:00
llm.py [TRTLLM-9735][feat] Add processed logprobs functionality to TorchSampler (#9675) 2026-01-16 10:52:41 -08:00
mgmn_leader_node.py [https://nvbugs/5783876][fix] fix hmac launch (#10434) 2026-01-22 23:20:53 +08:00
mgmn_worker_node.py Update TensorRT-LLM (#2333) 2024-10-15 15:28:40 +08:00
mm_encoder.py [TRTLLM-9409][feat] Pass MRoPE tensors for EPD disagg (#9758) 2025-12-22 06:32:49 -05:00
mpi_session.py [cherry-pick][https://nvbugs/5670793][fix] Solve trtllm-serve launch_disaggregated issue (#9346) 2025-11-27 16:13:58 +08:00
reasoning_parser.py [None][feat] Update reasoning parser for nano-v3 (#9944) 2025-12-15 05:39:37 -08:00
rlhf_utils.py [TRTLLM-9771][feat] Support partial update weight for fp8 (#10456) 2026-01-22 14:46:05 +08:00
tokenizer.py [TRTLLM-9654][feat] Support DeepSeek-V32 chat template (#9814) 2025-12-19 17:05:38 +08:00
tracer.py Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
tracing.py [None][feat] Add opentelemetry tracing (#5897) 2025-10-27 18:51:07 +08:00
trtllm-llmapi-launch [https://nvbugs/5569754][fix] trtllm-llmapi-launch port conflict (#8582) 2025-11-20 12:43:13 -05:00
utils.py [None][feat] Auto download speculative models from HF for pytorch backend, add speculative_model field alias (#10099) 2026-01-14 21:06:07 -08:00