TensorRT-LLMs/tensorrt_llm/serve
Yegor 5b7007a69d [feat] Detokenize option in /v1/completions request (#5382)
Signed-off-by: Yegor <75512761+Wokzy@users.noreply.github.com>
Signed-off-by: Yegor Yershov <yegor6741@gmail.com>
2025-07-10 22:50:36 -07:00
..
scripts feat: Add support for TRTLLM CustomDataset (#5511) 2025-06-26 18:27:37 +08:00
__init__.py Update TensorRT-LLM (#2820) 2025-02-25 21:21:49 +08:00
chat_utils.py [TRTLLM-5053] Refactoring and Unifying the Multimodal input preparation (#4506) 2025-06-03 12:02:07 -07:00
metadata_server.py feat: Add integration of etcd (#3738) 2025-06-03 20:01:44 +08:00
openai_disagg_server.py feat: Dynamically remove servers in PD (#5270) 2025-06-25 09:50:04 +08:00
openai_protocol.py [feat] Detokenize option in /v1/completions request (#5382) 2025-07-10 22:50:36 -07:00
openai_server.py [TRTLLM-5208][BREAKING CHANGE] chore: make pytorch LLM the default (#5312) 2025-06-20 03:01:10 +08:00
postprocess_handlers.py [feat] Detokenize option in /v1/completions request (#5382) 2025-07-10 22:50:36 -07:00
router.py feat: Dynamically remove servers in PD (#5270) 2025-06-25 09:50:04 +08:00