kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
fd1270b9ab
TensorRT-LLMs/tensorrt_llm/serve
History
Erin 89dabf5aa1
[TRTLLM-9736][feat] AsyncLLM and verl integ (#9353) 
Signed-off-by: Liwei Ma <liweim@nvidia.com>
Signed-off-by: Yuan Tong <13075180+tongyuantongyu@users.noreply.github.com>
Signed-off-by: Superjomn <328693+Superjomn@users.noreply.github.com>
Signed-off-by: Erin Ho <14718778+hchings@users.noreply.github.com>
Co-authored-by: Liwei Ma <liweim@nvidia.com>
Co-authored-by: Yuan Tong <13075180+tongyuantongyu@users.noreply.github.com>
Co-authored-by: Superjomn <328693+Superjomn@users.noreply.github.com>
2025-12-11 09:33:25 -08:00
..
scripts [None][feat] support for more accurate AR calculation (#9323) 2025-11-29 00:34:21 +08:00
tool_parser [None][feat] Update Qwen3CodeToolParser to align tool-calling parameters (#9540) 2025-12-04 06:47:32 +08:00
__init__.py Update TensorRT-LLM (#2820) 2025-02-25 21:21:49 +08:00
chat_utils.py [None][feat] Support custom chat template for tool calling (#9297) 2025-11-25 22:07:04 +08:00
cluster_storage.py [TRTLLM-8431][doc] update public doc and example, add etcd auto-scaling tests (#8602) 2025-10-28 17:04:53 -07:00
disagg_auto_scaling.py [TRTLLM-8920][feat] decouple disagg service from fastapi (#8714) 2025-12-05 10:44:16 +08:00
harmony_adapter.py [https://nvbugs/5521799][fix] Trim incorrectly generated harmony messages (#7849) 2025-09-24 16:38:43 +08:00
metadata_server.py feat: Add integration of etcd (#3738) 2025-06-03 20:01:44 +08:00
openai_client.py [TRTLLM-8920][feat] decouple disagg service from fastapi (#8714) 2025-12-05 10:44:16 +08:00
openai_disagg_server.py [TRTLLM-8920][feat] decouple disagg service from fastapi (#8714) 2025-12-05 10:44:16 +08:00
openai_disagg_service.py [TRTLLM-8920][feat] decouple disagg service from fastapi (#8714) 2025-12-05 10:44:16 +08:00
openai_protocol.py [TRTLLM-9736][feat] AsyncLLM and verl integ (#9353) 2025-12-11 09:33:25 -08:00
openai_server.py [TRTLLM-9736][feat] AsyncLLM and verl integ (#9353) 2025-12-11 09:33:25 -08:00
openai_service.py [TRTLLM-8920][feat] decouple disagg service from fastapi (#8714) 2025-12-05 10:44:16 +08:00
perf_metrics.py [TRTLLM-8920][feat] decouple disagg service from fastapi (#8714) 2025-12-05 10:44:16 +08:00
postprocess_handlers.py [TRTLLM-8214][feat] Support Qwen3 tool parser (#8216) 2025-10-29 15:48:29 +08:00
responses_utils.py [TRTLLM-8920][feat] decouple disagg service from fastapi (#8714) 2025-12-05 10:44:16 +08:00
router.py [TRTLLM-8431][doc] update public doc and example, add etcd auto-scaling tests (#8602) 2025-10-28 17:04:53 -07:00