This website requires JavaScript.
Explore
Help
Sign In
kanshan
/
TensorRT-LLMs
Watch
1
Star
0
Fork
0
You've already forked TensorRT-LLMs
mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced
2026-01-14 06:27:45 +08:00
Code
Issues
Actions
1
Packages
Projects
Releases
Wiki
Activity
7279297717
TensorRT-LLMs
/
cpp
/
tensorrt_llm
/
common
History
Tian Zheng
e257cb3533
[None][feat] Support NVFP4 KV Cache (
#6244
)
...
Signed-off-by: Tian Zheng <29906817+Tom-Zheng@users.noreply.github.com>
2025-09-01 09:24:52 +08:00
..
assert.cpp
attentionOp.cpp
[None][feat] Support NVFP4 KV Cache (
#6244
)
2025-09-01 09:24:52 +08:00
attentionOp.h
[None][feat] Support NVFP4 KV Cache (
#6244
)
2025-09-01 09:24:52 +08:00
CMakeLists.txt
feat: reduce unnecessary kernel generation (
#5476
)
2025-07-04 14:37:49 +08:00
cublasMMWrapper.cpp
cublasMMWrapper.h
cublasVersionCheck.h
cudaBf16Fallbacks.cuh
cudaBufferUtils.cuh
cudaDriverWrapper.cpp
[nvbug 5333996 ][fix] Unload XQA cubins early to avoid static lifetime (
#5133
)
2025-06-13 15:53:29 +08:00
cudaDriverWrapper.h
[TRTLLM-4406][feat] LLM sleep & wakeup Part 1: virtual device memory (
#5034
)
2025-08-04 13:51:01 +08:00
cudaFp8Utils.cu
Add Llama 4 (
#3302
)
2025-04-09 03:35:21 +08:00
cudaProfilerUtils.cpp
cudaTypeUtils.cuh
customAllReduceUtils.h
envUtils.cpp
[None][feat] CUTLASS MoE FC2+Finalize fusion (
#3294
)
2025-08-12 15:56:48 +08:00
envUtils.h
[None][feat] CUTLASS MoE FC2+Finalize fusion (
#3294
)
2025-08-12 15:56:48 +08:00
jsonSerializeOptional.h
logger.cpp
chore: improve log-level setting UX (
#4352
)
2025-05-16 09:47:44 +01:00
mathUtils.h
mcastDevMemUtils.cpp
Adding two-shot allreduce kernel and mnnvl multicasting buffer (
#4216
)
2025-05-22 03:42:36 +08:00
mcastDevMemUtils.h
Adding two-shot allreduce kernel and mnnvl multicasting buffer (
#4216
)
2025-05-22 03:42:36 +08:00
memoryUtils.cu
feat: Add group_rms_norm kernel to normalize multiple inputs in a single operator. (
#3438
)
2025-05-02 13:25:30 +08:00
memoryUtils.h
nvtxUtils.h
opUtils.cpp
feat: forward exceptions to Python and catch OOMs (
#4497
)
2025-05-28 11:58:10 +02:00
opUtils.h
feat: forward exceptions to Python and catch OOMs (
#4497
)
2025-05-28 11:58:10 +02:00
quantTypeUtils.cuh
reduceKernelUtils.cuh
safetensors.cpp
safetensors.h
stlUtils.h
stringUtils.cpp
[None][fix] Using RAII to automatically manage the allocation and release of va_list for potential resource leak (
#6758
)
2025-08-16 15:19:19 +08:00
timestampUtils.cpp
timestampUtils.h
tllmException.cpp
feat: forward exceptions to Python and catch OOMs (
#4497
)
2025-05-28 11:58:10 +02:00
workspace.h
[
https://nvbugs/5415862
][fix] Update cublas as 12.9.1 and cuda memory alignment as 256 (
#6501
)
2025-08-15 11:10:59 +08:00
