TensorRT-LLMs/cpp/tensorrt_llm/common
Haohang Huang c9eebcb454
[TRTLLM-6674][feat] (Breaking Change) Hopper SWA non-cyclic kernels + KV reuse + Spec Dec (#6379)
Signed-off-by: Haohang Huang <31998628+symphonylyh@users.noreply.github.com>
Signed-off-by: symphonylyh <31998628+symphonylyh@users.noreply.github.com>
2025-08-05 07:47:41 +00:00
..
assert.cpp
attentionOp.cpp [TRTLLM-6674][feat] (Breaking Change) Hopper SWA non-cyclic kernels + KV reuse + Spec Dec (#6379) 2025-08-05 07:47:41 +00:00
attentionOp.h [TRTLLM-6674][feat] (Breaking Change) Hopper SWA non-cyclic kernels + KV reuse + Spec Dec (#6379) 2025-08-05 07:47:41 +00:00
CMakeLists.txt feat: reduce unnecessary kernel generation (#5476) 2025-07-04 14:37:49 +08:00
cublasMMWrapper.cpp
cublasMMWrapper.h
cublasVersionCheck.h
cudaBf16Fallbacks.cuh
cudaBufferUtils.cuh
cudaDriverWrapper.cpp [nvbug 5333996 ][fix] Unload XQA cubins early to avoid static lifetime (#5133) 2025-06-13 15:53:29 +08:00
cudaDriverWrapper.h [TRTLLM-4406][feat] LLM sleep & wakeup Part 1: virtual device memory (#5034) 2025-08-04 13:51:01 +08:00
cudaFp8Utils.cu
cudaProfilerUtils.cpp
cudaTypeUtils.cuh
customAllReduceUtils.h
envUtils.cpp feat: Support structural tag in C++ runtime and upgrade xgrammar to 0.1.21 (#6408) 2025-07-31 09:53:52 +08:00
envUtils.h feat: Support structural tag in C++ runtime and upgrade xgrammar to 0.1.21 (#6408) 2025-07-31 09:53:52 +08:00
jsonSerializeOptional.h
logger.cpp
mathUtils.h
mcastDevMemUtils.cpp Adding two-shot allreduce kernel and mnnvl multicasting buffer (#4216) 2025-05-22 03:42:36 +08:00
mcastDevMemUtils.h Adding two-shot allreduce kernel and mnnvl multicasting buffer (#4216) 2025-05-22 03:42:36 +08:00
memoryUtils.cu
memoryUtils.h
nvtxUtils.h
opUtils.cpp feat: forward exceptions to Python and catch OOMs (#4497) 2025-05-28 11:58:10 +02:00
opUtils.h feat: forward exceptions to Python and catch OOMs (#4497) 2025-05-28 11:58:10 +02:00
quantTypeUtils.cuh
reduceKernelUtils.cuh
safetensors.cpp
safetensors.h
stlUtils.h
stringUtils.cpp
timestampUtils.cpp
timestampUtils.h
tllmException.cpp feat: forward exceptions to Python and catch OOMs (#4497) 2025-05-28 11:58:10 +02:00
workspace.h