Zheyu Fu bac665e650 [TRTLLM-7412][feat] Turn off spec decode when the rolling average acceptance length drops below threshold. (#7283) ... Signed-off-by: Zheyu Fu <zheyuf@NVIDIA.com>		2025-10-13 15:51:14 -07:00
..
__init__.py	[None][feat] Draft: Save state first pass (#7012)	2025-10-01 18:40:55 -04:00
build_cache.py	[None][fix] Refactoring to avoid circular import when importing torch models (#6720)	2025-08-11 18:00:42 -04:00
disagg_utils.py	[TRTLLM-7846][feat] Http disagg-cluster management implemention (#7869)	2025-10-09 09:44:01 +08:00
llm_args.py	[TRTLLM-7412][feat] Turn off spec decode when the rolling average acceptance length drops below threshold. (#7283)	2025-10-13 15:51:14 -07:00
llm_utils.py	[None][chroe] Rename TensorRT-LLM to TensorRT LLM for source code. (#7851)	2025-09-25 21:02:35 +08:00
llm.py	[TRTLLM-7349][feat] Adding new orchestrator type -- ray (#7520)	2025-10-04 08:12:24 +08:00
mgmn_leader_node.py	fix[nvbug5298640]: trtllm-llmapi-launch multiple LLM instances (#4727)	2025-06-19 06:13:53 +08:00
mgmn_worker_node.py	Update TensorRT-LLM (#2333)	2024-10-15 15:28:40 +08:00
mm_encoder.py	[None][chore] Create PyExecutor from TorchLlmArgs Part 1 (#7105)	2025-08-26 10:42:01 +08:00
mpi_session.py	[None][chore] Mass integration of release/1.0 - 3rd (#7519)	2025-09-08 14:03:04 +08:00
reasoning_parser.py	feat: add deepseek-r1 reasoning parser to trtllm-serve (#3354)	2025-05-06 08:13:04 +08:00
tokenizer.py	[None] [feat] Add Tencent HunYuanMoEV1 model support (#5521)	2025-08-15 06:56:44 +08:00
tracer.py	Update TensorRT-LLM (#2413)	2024-11-05 16:27:06 +08:00
trtllm-llmapi-launch	[TRTLLM-6295][test] Exit as early as possible and propagate exit status correctly for multi-node testing (#7739)	2025-09-16 09:59:18 +08:00
utils.py	[TRTLLM-8189][chore] enhance GenerationExecutor with RPC (part1) (#5543)	2025-10-05 17:28:20 +08:00