TensorRT-LLMs/cpp
Enwei Zhu 5b4852b7b5
feat: large-scale EP(part 5: Static EP load balancer with offline statistics) (#4695)
Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com>
2025-06-02 01:25:02 +08:00
..
cmake feat: NIXL interface integration (#3934) 2025-05-19 18:18:22 +08:00
include/tensorrt_llm [nvbug 5305210] fix: Resolve nvbug 5305210 (#4759) 2025-05-31 19:21:06 +08:00
kernels fix: fmha_v2 compilation (#4659) 2025-05-27 17:39:39 +08:00
micro_benchmarks [perf] Reduce the workspace size of FP4 activation scales for MoE (#4303) 2025-05-30 09:03:52 +08:00
tensorrt_llm feat: large-scale EP(part 5: Static EP load balancer with offline statistics) (#4695) 2025-06-02 01:25:02 +08:00
tests fix: EP load balancer with MTP layer and route offset by EP rank (#4767) 2025-06-01 00:07:44 +08:00
CMakeLists.txt fix: better method to help torch find nvtx3 (#4110) 2025-05-15 16:42:30 +08:00
conandata.yml infra: add conan (#3744) 2025-04-30 11:53:14 -07:00
conanfile.py infra: add conan (#3744) 2025-04-30 11:53:14 -07:00