TensorRT-LLMs/tensorrt_llm/llmapi
Tian Zheng e257cb3533
[None][feat] Support NVFP4 KV Cache (#6244)
Signed-off-by: Tian Zheng <29906817+Tom-Zheng@users.noreply.github.com>
2025-09-01 09:24:52 +08:00
..
__init__.py [TRTLLM-7326][feat] Add standalone multimodal encoder (#6743) 2025-08-19 21:42:50 -07:00
build_cache.py [None][fix] Refactoring to avoid circular import when importing torch models (#6720) 2025-08-11 18:00:42 -04:00
disagg_utils.py [None][feat] Add logging for OAI disagg server (#7232) 2025-08-26 21:02:03 -07:00
llm_args.py [None][feat] KV Cache Connector API (#7228) 2025-08-28 23:09:27 -04:00
llm_utils.py [None][feat] Support NVFP4 KV Cache (#6244) 2025-09-01 09:24:52 +08:00
llm.py [None][feat] KV Cache Connector API (#7228) 2025-08-28 23:09:27 -04:00
mgmn_leader_node.py
mgmn_worker_node.py
mm_encoder.py [None][chore] Create PyExecutor from TorchLlmArgs Part 1 (#7105) 2025-08-26 10:42:01 +08:00
mpi_session.py
reasoning_parser.py
tokenizer.py [None] [feat] Add Tencent HunYuanMoEV1 model support (#5521) 2025-08-15 06:56:44 +08:00
tracer.py
trtllm-llmapi-launch
utils.py [TRTLLM-7157][feat] BREAKING CHANGE Introduce sampler_type, detect sampler according to options (#6831) 2025-08-16 00:27:24 -04:00