kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
943fd418dd
TensorRT-LLMs/triton_backend
History
Aurelien Chartier 6a47cac981
feat: Add support for Triton request cancellation (#5898) 
Signed-off-by: Aurelien Chartier <2567591+achartier@users.noreply.github.com>
2025-07-15 20:52:43 -04:00
..
all_models feat: Add support for Triton request cancellation (#5898) 2025-07-15 20:52:43 -04:00
ci Move Triton backend to TRT-LLM main (#3549) 2025-05-16 07:15:23 +08:00
inflight_batcher_llm [nvbugs/5309940] Add support for input output token counts (#5445) 2025-06-28 04:39:39 +08:00
scripts [nvbug/5308432] fix: extend triton exit time for test_llava (#5971) 2025-07-12 12:56:37 +09:00
tools feat: Add support for Triton request cancellation (#5898) 2025-07-15 20:52:43 -04:00
requirements.txt Move Triton backend to TRT-LLM main (#3549) 2025-05-16 07:15:23 +08:00