TensorRT-LLMs/tensorrt_llm/llmapi
Pengyun Lin 0a0ac7b5dc
[nvbug 5304752][fix] enhance _check_arguments to filter illegal requests for pytorch backend (#5541)
Signed-off-by: Pengyun Lin <81065165+LinPoly@users.noreply.github.com>
2025-07-07 19:26:13 +08:00
..
__init__.py chore: partition LLM class into TorchLLM and TrtLLM (#4900) 2025-06-18 14:01:25 +08:00
build_cache.py Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
disagg_utils.py chore: improve disagg test failure detection (#4738) 2025-06-15 01:28:26 +08:00
llm_args.py chore: remove torch_compile prefix for TorchCompileConfig field members (#5261) 2025-06-19 09:21:51 +08:00
llm_utils.py Speculation: Draft Target in new FW (#4558) 2025-06-17 02:26:08 +08:00
llm.py [nvbug 5304752][fix] enhance _check_arguments to filter illegal requests for pytorch backend (#5541) 2025-07-07 19:26:13 +08:00
mgmn_leader_node.py fix[nvbug5298640]: trtllm-llmapi-launch multiple LLM instances (#4727) 2025-06-19 06:13:53 +08:00
mgmn_worker_node.py
mpi_session.py fix[nvbug5298640]: trtllm-llmapi-launch multiple LLM instances (#4727) 2025-06-19 06:13:53 +08:00
reasoning_parser.py feat: add deepseek-r1 reasoning parser to trtllm-serve (#3354) 2025-05-06 08:13:04 +08:00
tokenizer.py feat: Add LLGuidance Support for PyTorch Backend (#5214) 2025-06-18 19:33:34 +08:00
tracer.py Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
trtllm-llmapi-launch fix[nvbug5298640]: trtllm-llmapi-launch multiple LLM instances (#4727) 2025-06-19 06:13:53 +08:00
utils.py chore [BREAKING CHANGE]: Flatten PyTorchConfig knobs into TorchLlmArgs (#4603) 2025-05-28 18:43:04 +08:00