TensorRT-LLMs/tensorrt_llm/serve
Shi Xiaowei 3ee8523829
[https://nvbugs/5450074][fix] Reduce the device memory requirements for testing (#6990)
Signed-off-by: Shixiaowei02 <39303645+Shixiaowei02@users.noreply.github.com>
2025-08-22 17:33:30 +08:00
..
scripts [TRTLLM-6675][infra] Nixl test completion (#6623) 2025-08-08 10:15:54 +08:00
__init__.py Update TensorRT-LLM (#2820) 2025-02-25 21:21:49 +08:00
chat_utils.py feat: TRTLLM-5574 Add phi-4-multimodal pytorch-backend support (#5644) 2025-07-17 06:30:58 +08:00
metadata_server.py feat: Add integration of etcd (#3738) 2025-06-03 20:01:44 +08:00
openai_disagg_server.py [https://nvbugs/5450074][fix] Reduce the device memory requirements for testing (#6990) 2025-08-22 17:33:30 +08:00
openai_protocol.py [TRTLLM-6761][refactor] Replace LogitBiasLogitsProcessor with embedding bias tensor system (#6464) 2025-08-05 07:14:24 -07:00
openai_server.py [TRTLLM-6761][refactor] Replace LogitBiasLogitsProcessor with embedding bias tensor system (#6464) 2025-08-05 07:14:24 -07:00
postprocess_handlers.py [feat] Detokenize option in /v1/completions request (#5382) 2025-07-08 19:36:04 +08:00
router.py feat: Dynamically remove servers in PD (#5270) 2025-06-25 09:50:04 +08:00