TensorRT-LLMs/tensorrt_llm/serve
pcastonguay 3a04c9fa7b
chore: Include prompt_token_ids only for context-only disagg requests (#5055)
Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com>
2025-06-12 15:00:08 -04:00
..
scripts [feat] support sharegpt downloading in benchmark_serving (#4578) 2025-05-30 17:27:53 +08:00
__init__.py Update TensorRT-LLM (#2820) 2025-02-25 21:21:49 +08:00
chat_utils.py [TRTLLM-5053] Refactoring and Unifying the Multimodal input preparation (#4506) 2025-06-03 12:02:07 -07:00
metadata_server.py feat: Add integration of etcd (#3738) 2025-06-03 20:01:44 +08:00
openai_disagg_server.py Refactor the first token response in PD (#4692) 2025-06-04 09:11:23 +08:00
openai_protocol.py [TRTLLM-1658][feat] Enable multiple response in trtllm-serve for TRT backend (#4623) 2025-05-28 11:36:44 +08:00
openai_server.py chore: Include prompt_token_ids only for context-only disagg requests (#5055) 2025-06-12 15:00:08 -04:00
postprocess_handlers.py feat: add deepseek-r1 reasoning parser to trtllm-serve (#3354) 2025-05-06 08:13:04 +08:00
router.py feat: Add integration of etcd (#3738) 2025-06-03 20:01:44 +08:00