kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
75d020cf07
TensorRT-LLMs/cpp
History
Anthony Chang eeb555e37b
chore: memoize weight shuffle index to speed up weight preproc in moe_backend=TRTLLM (#4826) 
Signed-off-by: Anthony Chang <27950904+rosenrodt@users.noreply.github.com>
2025-06-06 16:13:54 +08:00
..
cmake feat: NIXL interface integration (#3934) 2025-05-19 18:18:22 +08:00
include/tensorrt_llm fix: correct the order of llm request state (#4781) 2025-06-04 14:45:13 +08:00
kernels update fmha_v2 (#4895) 2025-06-05 22:14:28 +08:00
micro_benchmarks [perf] Reduce the workspace size of FP4 activation scales for MoE (#4303) 2025-05-30 09:03:52 +08:00
tensorrt_llm chore: memoize weight shuffle index to speed up weight preproc in moe_backend=TRTLLM (#4826) 2025-06-06 16:13:54 +08:00
tests chore: Mass integration of release/0.20. (#4871) 2025-06-04 14:12:27 +08:00
CMakeLists.txt fix: better method to help torch find nvtx3 (#4110) 2025-05-15 16:42:30 +08:00
conandata.yml infra: add conan (#3744) 2025-04-30 11:53:14 -07:00
conanfile.py infra: add conan (#3744) 2025-04-30 11:53:14 -07:00