Shunkangz fd27f89df6 fix: Remove duplicate tokenization in generation server (#4492) ... * Add nvtx Signed-off-by: Shunkang <182541032+Shunkangz@users.noreply.github.co> * Add draft change Signed-off-by: Shunkang <182541032+Shunkangz@users.noreply.github.co> * Refactor and add support of chat Signed-off-by: Shunkang <182541032+Shunkangz@users.noreply.github.co> --------- Signed-off-by: Shunkang <182541032+Shunkangz@users.noreply.github.co> Co-authored-by: Shunkang <182541032+Shunkangz@users.noreply.github.co>		2025-05-26 16:43:07 +08:00
..
scripts	bench: TRTLLM-4936 Port benchmark_serving.py (#4011)	2025-05-07 09:45:14 +08:00
__init__.py	Update TensorRT-LLM (#2820)	2025-02-25 21:21:49 +08:00
chat_utils.py	fix: Fix chat template kwargs bug. (#4387)	2025-05-16 23:07:46 +08:00
openai_disagg_server.py	fix: Remove duplicate tokenization in generation server (#4492)	2025-05-26 16:43:07 +08:00
openai_protocol.py	fix: Remove duplicate tokenization in generation server (#4492)	2025-05-26 16:43:07 +08:00
openai_server.py	fix: Remove duplicate tokenization in generation server (#4492)	2025-05-26 16:43:07 +08:00
postprocess_handlers.py	feat: add deepseek-r1 reasoning parser to trtllm-serve (#3354)	2025-05-06 08:13:04 +08:00
router.py	feat: conditional disaggregation in disagg server (#3974)	2025-05-21 09:57:46 +08:00