Pengbo Wang @ NVIDIA c289880afb [None][fix] fix kimi k2 serving and add test for Kimi-K2 (#6589) ... Signed-off-by: Pengbo Wang <221450789+pengbowang-nv@users.noreply.github.com>		2025-08-05 18:05:33 +08:00
..
__init__.py	[feat] Auto-enable ngram with concurrency <= 32. (#6232)	2025-07-31 18:45:51 -04:00
build_cache.py	Update TensorRT-LLM (#2413)	2024-11-05 16:27:06 +08:00
disagg_utils.py	[Disaggregated] Add retry knobs and handling (#5808)	2025-07-19 07:27:59 +08:00
llm_args.py	Deepseek R1 FP8 Support on Blackwell (#6486)	2025-08-01 10:26:28 +08:00
llm_utils.py	feat: add support for Modelopt fp8_pb_wo quantization scheme (#6106)	2025-07-18 10:35:12 +08:00
llm.py	[None][fix] Revert commit 48ddc3d & add test for disagg server with different max_num_tokens (#6259)	2025-08-04 15:09:51 +08:00
mgmn_leader_node.py	fix[nvbug5298640]: trtllm-llmapi-launch multiple LLM instances (#4727)	2025-06-19 06:13:53 +08:00
mgmn_worker_node.py	Update TensorRT-LLM (#2333)	2024-10-15 15:28:40 +08:00
mpi_session.py	fix[nvbug5298640]: trtllm-llmapi-launch multiple LLM instances (#4727)	2025-06-19 06:13:53 +08:00
reasoning_parser.py	feat: add deepseek-r1 reasoning parser to trtllm-serve (#3354)	2025-05-06 08:13:04 +08:00
tokenizer.py	[None][fix] fix kimi k2 serving and add test for Kimi-K2 (#6589)	2025-08-05 18:05:33 +08:00
tracer.py	Update TensorRT-LLM (#2413)	2024-11-05 16:27:06 +08:00
trtllm-llmapi-launch	fix[nvbug5298640]: trtllm-llmapi-launch multiple LLM instances (#4727)	2025-06-19 06:13:53 +08:00
utils.py	[TRTLLM-5061] chore: add status tags to LLM API reference (#5707)	2025-07-28 15:57:07 +08:00