TensorRT-LLMs

mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00

History

Chuang Zhu 44cfd757b2 Agent interface impl for NIXL (#4125 ) * agentConnection Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> recv Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> agentState Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> NIXL interfaces Signed-off-by: Shixiaowei02 <39303645+Shixiaowei02@users.noreply.github.com> update cmakelists Signed-off-by: Shixiaowei02 <39303645+Shixiaowei02@users.noreply.github.com> nixl improve Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> remove cppzmq Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> fix Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> transferAgent remove register Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> work for cache Test Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> reduce sleep time Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> fix test Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> intergarte Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> nixl env Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> fix rebase error Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> cpp test Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> stash for send metaData Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> loadRemoteMD after fetchRemoteMD Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> workaround for mixed gen and context Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> test_env Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> avoid port conflict in test Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> * format Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> * use std::string Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> * typo Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> * fix transferAgentTest Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> --------- Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>		2025-05-22 09:09:41 +08:00
..
assert.cpp	Update TensorRT-LLM (#1725 )	2024-06-04 20:26:32 +08:00
attentionOp.cpp	Feat: add chunked-attention kernels on Blackwell (#4394 )	2025-05-21 10:16:46 +08:00
attentionOp.h	fix: [https://nvbugspro.nvidia.com/bug/5243482 ] If FlashMLA is used, the existence of FMHA based MLA kernels should not be checked. (#3862 )	2025-04-30 14:27:38 +08:00
CMakeLists.txt	Update TensorRT-LLM (#2792 )	2025-02-18 21:27:39 +08:00
cublasMMWrapper.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
cublasMMWrapper.h	Update TensorRT-LLM (#2582 )	2024-12-16 21:50:47 -08:00
cublasVersionCheck.h	Initial commit	2023-09-20 00:29:41 -07:00
cudaBf16Fallbacks.cuh	Update TensorRT-LLM (20240116) (#891 )	2024-01-16 20:03:11 +08:00
cudaBufferUtils.cuh	Update TensorRT-LLM (#2783 )	2025-02-13 18:40:22 +08:00
cudaDriverWrapper.cpp	feat: add CGA reduction fmha kernels on Blackwell. (#3763 )	2025-04-29 10:43:54 +08:00
cudaDriverWrapper.h	feat: add CGA reduction fmha kernels on Blackwell. (#3763 )	2025-04-29 10:43:54 +08:00
cudaFp8Utils.cu	Add Llama 4 (#3302 )	2025-04-09 03:35:21 +08:00
cudaProfilerUtils.cpp	Update TensorRT-LLM (#1954 )	2024-07-16 15:30:25 +08:00
cudaTypeUtils.cuh	Update TensorRT-LLM (#2008 )	2024-07-23 23:05:09 +08:00
customAllReduceUtils.h	Update TensorRT-LLM (#2755 )	2025-02-11 03:01:00 +00:00
envUtils.cpp	Agent interface impl for NIXL (#4125 )	2025-05-22 09:09:41 +08:00
envUtils.h	Agent interface impl for NIXL (#4125 )	2025-05-22 09:09:41 +08:00
jsonSerializeOptional.h	Update TensorRT-LLM (#2436 )	2024-11-12 15:27:49 +08:00
logger.cpp	chore: improve log-level setting UX (#4352 )	2025-05-16 09:47:44 +01:00
mathUtils.h	Update TensorRT-LLM (#2094 )	2024-08-07 16:44:43 +08:00
mcastDevMemUtils.cpp	Adding two-shot allreduce kernel and mnnvl multicasting buffer (#4216 )	2025-05-22 03:42:36 +08:00
mcastDevMemUtils.h	Adding two-shot allreduce kernel and mnnvl multicasting buffer (#4216 )	2025-05-22 03:42:36 +08:00
memoryUtils.cu	feat: Add group_rms_norm kernel to normalize multiple inputs in a single operator. (#3438 )	2025-05-02 13:25:30 +08:00
memoryUtils.h	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
nvtxUtils.h	Update TensorRT-LLM (#2755 )	2025-02-11 03:01:00 +00:00
opUtils.cpp	refactor: Introduce MpiTag enumeration and update MPI function signatures (#3893 )	2025-05-04 13:24:29 +02:00
opUtils.h	Update TensorRT-LLM (#2792 )	2025-02-18 21:27:39 +08:00
quantTypeUtils.cuh	Update TensorRT-LLM (#2008 )	2024-07-23 23:05:09 +08:00
reduceKernelUtils.cuh	Update TensorRT-LLM (#2783 )	2025-02-13 18:40:22 +08:00
safetensors.cpp	Update TensorRT-LLM (#2792 )	2025-02-18 21:27:39 +08:00
safetensors.h	Update TensorRT-LLM (#2110 )	2024-08-13 22:34:33 +08:00
stlUtils.h	Update TensorRT-LLM (#1763 )	2024-06-11 16:59:02 +08:00
stringUtils.cpp	chore: Stabilize ABI boundary for internal kernel library (#3117 )	2025-04-11 15:07:50 +08:00
timestampUtils.cpp	Update TensorRT-LLM (#1954 )	2024-07-16 15:30:25 +08:00
timestampUtils.h	Update TensorRT-LLM (#1954 )	2024-07-16 15:30:25 +08:00
tllmException.cpp	chore: Stabilize ABI boundary for internal kernel library (#3117 )	2025-04-11 15:07:50 +08:00
workspace.h	Update TensorRT-LLM (#2184 )	2024-09-03 12:14:23 +02:00