Shunkangz 54ec2c1af1 [None][opt] Add batch wait timeout in fetching requests (#6923) ... Signed-off-by: Shunkang <182541032+Shunkangz@users.noreply.github.co>		2025-08-19 03:50:08 -04:00
..
__init__.py	[None][opt] ADP schedule balance optimization (#6061)	2025-08-06 09:38:02 +08:00
build_cache.py	[None][fix] Refactoring to avoid circular import when importing torch models (#6720)	2025-08-11 18:00:42 -04:00
disagg_utils.py	[Disaggregated] Add retry knobs and handling (#5808)	2025-07-19 07:27:59 +08:00
llm_args.py	[None][opt] Add batch wait timeout in fetching requests (#6923)	2025-08-19 03:50:08 -04:00
llm_utils.py	[None] [feat] Add model gpt-oss (#6645)	2025-08-07 03:04:18 -04:00
llm.py	[None][feat] Support SharedTensor on MultimodalParams (#6254)	2025-08-10 17:48:24 -07:00
mgmn_leader_node.py	fix[nvbug5298640]: trtllm-llmapi-launch multiple LLM instances (#4727)	2025-06-19 06:13:53 +08:00
mgmn_worker_node.py	Update TensorRT-LLM (#2333)	2024-10-15 15:28:40 +08:00
mpi_session.py	fix[nvbug5298640]: trtllm-llmapi-launch multiple LLM instances (#4727)	2025-06-19 06:13:53 +08:00
reasoning_parser.py	feat: add deepseek-r1 reasoning parser to trtllm-serve (#3354)	2025-05-06 08:13:04 +08:00
tokenizer.py	[None] [feat] Add Tencent HunYuanMoEV1 model support (#5521)	2025-08-15 06:56:44 +08:00
tracer.py	Update TensorRT-LLM (#2413)	2024-11-05 16:27:06 +08:00
trtllm-llmapi-launch	fix[nvbug5298640]: trtllm-llmapi-launch multiple LLM instances (#4727)	2025-06-19 06:13:53 +08:00
utils.py	[TRTLLM-7157][feat] BREAKING CHANGE Introduce sampler_type, detect sampler according to options (#6831)	2025-08-16 00:27:24 -04:00