TensorRT-LLMs/tensorrt_llm/serve
Guoming Zhang 202bed4574 [None][chroe] Rename TensorRT-LLM to TensorRT LLM for source code. (#7851)
Signed-off-by: nv-guomingz <137257613+nv-guomingz@users.noreply.github.com>
Signed-off-by: Wangshanshan <30051912+dominicshanshan@users.noreply.github.com>
2025-09-25 21:02:35 +08:00
..
scripts [None][chroe] Rename TensorRT-LLM to TensorRT LLM for source code. (#7851) 2025-09-25 21:02:35 +08:00
__init__.py Update TensorRT-LLM (#2820) 2025-02-25 21:21:49 +08:00
chat_utils.py [TRTLLM-6771][feat] Support MMMU for multimodal models (#6828) 2025-08-21 08:54:12 +08:00
harmony_adapter.py [https://nvbugs/5521799][fix] Trim incorrectly generated harmony messages (#7849) 2025-09-24 16:38:43 +08:00
metadata_server.py feat: Add integration of etcd (#3738) 2025-06-03 20:01:44 +08:00
openai_disagg_server.py [TRTLLM-7182][test] add multi-nodes test for disagg-serving (#7470) 2025-09-24 08:31:56 +08:00
openai_protocol.py [TRTLLM-5235][feat] Enable regex and EBNF grammar in trtllm-serve (#7925) 2025-09-24 18:30:23 +08:00
openai_server.py [https://nvbugs/5521799][fix] Trim incorrectly generated harmony messages (#7849) 2025-09-24 16:38:43 +08:00
postprocess_handlers.py [https://nvbugs/5521799][fix] Trim incorrectly generated harmony messages (#7849) 2025-09-24 16:38:43 +08:00
responses_utils.py [TRTLLM-7208][feat] Implement basic functionalities for Responses API (#7341) 2025-09-02 07:08:22 -04:00
router.py feat: Dynamically remove servers in PD (#5270) 2025-06-25 09:50:04 +08:00