TensorRT-LLMs/cpp/tensorrt_llm
2025-09-26 14:29:32 -07:00
..
batch_manager [None][feature] Add environment variable to adjust block pool allocation ration under kv cache manager (#7923) 2025-09-26 14:09:01 +08:00
common [None][feat] Optimize kv cache transfer TEP (#7613) 2025-09-25 20:20:04 -07:00
cutlass_extensions/include/cutlass_extensions [TRTLLM-6286] [perf] Add NoSmem epilogue schedule and dynamic cluster shape for sm10x group gemm (#7757) 2025-09-21 11:38:17 +08:00
deep_ep [None][feat] DeepEP LL fp8 dispatch/combine (#7927) 2025-09-25 09:20:24 +08:00
deep_gemm [https://nvbugs/5433581][fix] DeepGEMM installation on SBSA (#6588) 2025-08-06 16:44:21 +08:00
executor [TRTLLM-7989][infra] Bundle UCX and NIXL libs in the TRTLLM python package (#7766) 2025-09-22 16:43:35 +08:00
executor_worker Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
kernels [None][chroe] Rename TensorRT-LLM to TensorRT LLM for source code. (#7851) 2025-09-25 21:02:35 +08:00
layers refactor: Remove enforced sorted order of batch slots (#3502) 2025-07-14 17:23:02 +02:00
nanobind [#6102][fix] support non-system python installation (#7763) 2025-09-26 10:16:15 +08:00
plugins [None][chroe] Rename TensorRT-LLM to TensorRT LLM for source code. (#7851) 2025-09-25 21:02:35 +08:00
pybind [#6102][fix] support non-system python installation (#7763) 2025-09-26 10:16:15 +08:00
runtime [None][chroe] Rename TensorRT-LLM to TensorRT LLM for source code. (#7851) 2025-09-25 21:02:35 +08:00
testing fix: Improve chunking test and skip empty kernel calls (#5710) 2025-07-04 09:08:15 +02:00
thop [https://nvbugs/5518713][fix] Trtllm-gen moe backend for blockwise fp8 ckpt (Qwen3-235B-A22B-FP8) (#7856) 2025-09-26 14:29:32 -07:00
CMakeLists.txt [#6102][fix] support non-system python installation (#7763) 2025-09-26 10:16:15 +08:00