TensorRT-LLMs/cpp/tensorrt_llm
Zhenhua Wang 62298bc473
perf: customize cublastLt algo for Llamba 3.3 70B TP4 (#6315)
Signed-off-by: Zhenhua Wang <zhenhuaw@nvidia.com>
2025-07-24 23:01:15 +08:00
..
batch_manager [TRTLLM-5059][feat] Add KV cache reuse support for multimodal models (#5444) 2025-07-21 16:11:58 -07:00
common [https://nvbugs/5387771] fix deadlocks due to insufficient numSemaphores (#6262) 2025-07-23 11:20:55 +08:00
cutlass_extensions/include/cutlass_extensions Fix GEMM+AR fusion on blackwell (#5563) 2025-07-09 08:48:47 +08:00
deep_ep fix: Ensure mlx5 library is installed for deep_ep and remove deprecated python bindings (#6189) 2025-07-20 10:38:51 +08:00
executor chore:[BREAKING CHANGE] use cacheTransceiverConfig as knobs for disagg service (#5234) 2025-07-17 17:42:07 +08:00
executor_worker Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
kernels Update fmhaRunner.cpp to fix guardwords scan error (#6327) 2025-07-24 18:32:36 +08:00
layers refactor: Remove enforced sorted order of batch slots (#3502) 2025-07-14 17:23:02 +02:00
nanobind fix: bindings unit tests for nanobind (#6221) 2025-07-22 14:51:43 +01:00
plugins fix TMA error with GEMM+AR on TP=2 (#6075) 2025-07-18 10:26:08 +08:00
pybind fix: bindings unit tests for nanobind (#6221) 2025-07-22 14:51:43 +01:00
runtime fix TMA error with GEMM+AR on TP=2 (#6075) 2025-07-18 10:26:08 +08:00
testing fix: Improve chunking test and skip empty kernel calls (#5710) 2025-07-04 09:08:15 +02:00
thop perf: customize cublastLt algo for Llamba 3.3 70B TP4 (#6315) 2025-07-24 23:01:15 +08:00
CMakeLists.txt feat: binding type build argument (pybind, nanobind) (#5802) 2025-07-11 00:48:50 +09:00