TensorRT-LLMs/cpp/tensorrt_llm
Anthony Chang 4742c130db
[None][feat] Improve TRTLLM MoE in small hidden size throughput cases (#9377)
Signed-off-by: Anthony Chang <27950904+rosenrodt@users.noreply.github.com>
2025-11-25 09:09:27 +01:00
..
batch_manager [None][fix] enhance warning in cacheTransBuffer (#9390) 2025-11-24 02:17:54 -08:00
common [None][feat] Add TRTLLM_NIXL_KVCACHE_BACKEND environment variable for NIXL backend selection (#9075) 2025-11-17 15:39:55 -08:00
cutlass_extensions/include/cutlass_extensions [#8732][feat] Add ReLU2 to TRTLLM Cutlass MoE BF16 kernels (#9191) 2025-11-17 20:30:00 -08:00
deep_ep [TRTLLM-9197][infra] Move thirdparty stuff to it's own listfile (#8986) 2025-11-20 16:44:23 -08:00
deep_gemm [TRTLLM-9211][infra] Minor fixes to 3rdparty/CMakelists (#9365) 2025-11-23 22:57:02 -08:00
executor [TRTLLM-9197][infra] Move thirdparty stuff to it's own listfile (#8986) 2025-11-20 16:44:23 -08:00
executor_worker Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
flash_mla [TRTLLM-9211][infra] Minor fixes to 3rdparty/CMakelists (#9365) 2025-11-23 22:57:02 -08:00
kernels [None][feat] Improve TRTLLM MoE in small hidden size throughput cases (#9377) 2025-11-25 09:09:27 +01:00
layers [None][feat] Support ignored prompt length for penalties via new sampling config parameter (#8127) 2025-10-27 13:12:31 -04:00
nanobind [TRTLLM-9389][chore] Rename AlltoAll backend names (#9329) 2025-11-23 13:52:57 -08:00
plugins [None][fix] Fix the performance issue of FP8 blockwise grouped GEMM when using attention DP (#8501) 2025-10-27 10:18:19 +08:00
pybind [TRTLLM-9389][chore] Rename AlltoAll backend names (#9329) 2025-11-23 13:52:57 -08:00
runtime [None][refactor] decoding inputs, part 2 (#5799) 2025-11-18 14:38:51 +01:00
testing fix: Improve chunking test and skip empty kernel calls (#5710) 2025-07-04 09:08:15 +02:00
thop [None][feat] Support Yarn on QwQ-32B model (#9059) 2025-11-25 07:27:28 +08:00
CMakeLists.txt [TRTLLM-9286][feat] Integration of CuteDSL NVFP4 grouped GEMM (#8880) 2025-11-18 17:40:12 -08:00