TensorRT-LLMs/cpp
dongxuy04 490d2e5819
feat: large-scale EP(part 8: Online EP load balancer integration for PCIe fp8) (#5226)
Signed-off-by: Dongxu Yang <78518666+dongxuy04@users.noreply.github.com>
2025-06-25 22:25:13 -07:00
..
cmake feat: NIXL interface integration (#3934) 2025-05-19 18:18:22 +08:00
include/tensorrt_llm opensource: Opensource MOE MXFP8-MXFP4 implementation (#5222) 2025-06-26 12:18:19 +08:00
kernels keep sm90 headsize 128 cubins (#5320) 2025-06-26 12:14:01 +08:00
micro_benchmarks opensource: Opensource MOE MXFP8-MXFP4 implementation (#5222) 2025-06-26 12:18:19 +08:00
tensorrt_llm feat: large-scale EP(part 8: Online EP load balancer integration for PCIe fp8) (#5226) 2025-06-25 22:25:13 -07:00
tests feat: large-scale EP(part 8: Online EP load balancer integration for PCIe fp8) (#5226) 2025-06-25 22:25:13 -07:00
CMakeLists.txt [Infra] - Update dependencies with NGC PyTorch 25.05 and TRT 10.11 (#4885) 2025-06-17 23:48:34 +08:00
conandata.yml infra: add conan (#3744) 2025-04-30 11:53:14 -07:00
conanfile.py feat: large-scale EP(part 6: Online EP load balancer integration for GB200 nvfp4) (#4818) 2025-06-08 10:25:18 +08:00
libnuma_conan.py fix cuda driver link issue with driver version less than 12.3 (#5025) 2025-06-10 15:27:39 +08:00