kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
3545d59635
TensorRT-LLMs/cpp/tensorrt_llm
History
Yao Yao 3545d59635
Support speculative decoding with Hopper XQA (#3269) 
Signed-off-by: Yao Yao <lowsfer@users.noreply.github.com>
2025-04-07 17:14:34 +08:00
..
batch_manager chore: remove usernames from comments (#3291) 2025-04-05 13:44:28 +08:00
common feat: Add support for FP8 MLA on Hopper and Blackwell. (#3190) 2025-04-07 15:14:13 +08:00
cutlass_extensions/include/cutlass_extensions feat: Update cutlass (#2981) 2025-03-26 22:36:27 +08:00
executor ucx interface (#3306) 2025-04-07 08:44:34 +08:00
executor_worker Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
kernels Support speculative decoding with Hopper XQA (#3269) 2025-04-07 17:14:34 +08:00
layers chore: remove usernames from comments (#3291) 2025-04-05 13:44:28 +08:00
plugins chore: remove usernames from comments (#3291) 2025-04-05 13:44:28 +08:00
pybind feat: support abort disconnected requests (#3214) 2025-04-07 16:14:58 +08:00
runtime chore: remove usernames from comments (#3291) 2025-04-05 13:44:28 +08:00
thop feat: Add support for FP8 MLA on Hopper and Blackwell. (#3190) 2025-04-07 15:14:13 +08:00
CMakeLists.txt [feat] open source fp8_blockscale_gemm (#3071) 2025-04-02 12:12:52 +08:00