TensorRT-LLMs/tensorrt_llm/llmapi
nv-guomingz 4e4d18826f
chore: [Breaking Change] Rename cuda_graph_config padding_enabled fie… (#6003)
Signed-off-by: nv-guomingz <137257613+nv-guomingz@users.noreply.github.com>
2025-07-15 15:50:03 +09:00
..
__init__.py chore: [Breaking Change] Rename cuda_graph_config padding_enabled fie… (#6003) 2025-07-15 15:50:03 +09:00
build_cache.py Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
disagg_utils.py feat: Dynamically remove servers in PD (#5270) 2025-06-25 09:50:04 +08:00
llm_args.py chore: [Breaking Change] Rename cuda_graph_config padding_enabled fie… (#6003) 2025-07-15 15:50:03 +09:00
llm_utils.py [refactor] Simplification of Speculative decoding configs (#5639) 2025-07-10 11:37:30 -04:00
llm.py [nvbug 5304752][fix] enhance _check_arguments to filter illegal requests for pytorch backend (#5541) 2025-07-14 17:17:30 +08:00
mgmn_leader_node.py fix[nvbug5298640]: trtllm-llmapi-launch multiple LLM instances (#4727) 2025-06-19 06:13:53 +08:00
mgmn_worker_node.py Update TensorRT-LLM (#2333) 2024-10-15 15:28:40 +08:00
mpi_session.py fix[nvbug5298640]: trtllm-llmapi-launch multiple LLM instances (#4727) 2025-06-19 06:13:53 +08:00
reasoning_parser.py feat: add deepseek-r1 reasoning parser to trtllm-serve (#3354) 2025-05-06 08:13:04 +08:00
tokenizer.py [NvBug 5370718, 5371538] fix: Fix incremental detokenization (#5825) 2025-07-10 16:30:00 +08:00
tracer.py Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
trtllm-llmapi-launch fix[nvbug5298640]: trtllm-llmapi-launch multiple LLM instances (#4727) 2025-06-19 06:13:53 +08:00
utils.py chore [BREAKING CHANGE]: Flatten PyTorchConfig knobs into TorchLlmArgs (#4603) 2025-05-28 18:43:04 +08:00