TensorRT-LLMs/cpp/tensorrt_llm
Chuang Zhu f98fa0cf8b
[None][feat] Optimize kv cache transfer TEP (#7613)
Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>
2025-09-25 20:20:04 -07:00
..
batch_manager [None][feat] Optimize kv cache transfer TEP (#7613) 2025-09-25 20:20:04 -07:00
common [None][feat] Optimize kv cache transfer TEP (#7613) 2025-09-25 20:20:04 -07:00
cutlass_extensions/include/cutlass_extensions [TRTLLM-6286] [perf] Add NoSmem epilogue schedule and dynamic cluster shape for sm10x group gemm (#7757) 2025-09-21 11:38:17 +08:00
deep_ep [None][feat] DeepEP LL fp8 dispatch/combine (#7927) 2025-09-25 09:20:24 +08:00
deep_gemm
executor [TRTLLM-7989][infra] Bundle UCX and NIXL libs in the TRTLLM python package (#7766) 2025-09-22 16:43:35 +08:00
executor_worker
kernels [None][chroe] Rename TensorRT-LLM to TensorRT LLM for source code. (#7851) 2025-09-25 21:02:35 +08:00
layers
nanobind [#6102][fix] support non-system python installation (#7763) 2025-09-26 10:16:15 +08:00
plugins [None][chroe] Rename TensorRT-LLM to TensorRT LLM for source code. (#7851) 2025-09-25 21:02:35 +08:00
pybind [#6102][fix] support non-system python installation (#7763) 2025-09-26 10:16:15 +08:00
runtime [None][chroe] Rename TensorRT-LLM to TensorRT LLM for source code. (#7851) 2025-09-25 21:02:35 +08:00
testing
thop [TRTLLM-5966][feat] Helix: add alltoall op (#6815) 2025-09-25 07:18:29 -07:00
CMakeLists.txt [#6102][fix] support non-system python installation (#7763) 2025-09-26 10:16:15 +08:00