dongxuy04 21aff2e313 feat: large-scale EP(part 2: MoE Load Balancer - core utilities) (#4384) ... * first commit of cpp moe loadbalance code Signed-off-by: Dongxu Yang <78518666+dongxuy04@users.noreply.github.com> * add python bindings for moe load balance Signed-off-by: Dongxu Yang <78518666+dongxuy04@users.noreply.github.com> * add python wrapper, ut and bug fixes Signed-off-by: Dongxu Yang <78518666+dongxuy04@users.noreply.github.com> * add binding for layerId and update binding test Signed-off-by: Dongxu Yang <78518666+dongxuy04@users.noreply.github.com> * add host tensor sharing and ut Signed-off-by: Dongxu Yang <78518666+dongxuy04@users.noreply.github.com> --------- Signed-off-by: Dongxu Yang <78518666+dongxuy04@users.noreply.github.com>		2025-05-20 17:53:48 +08:00
..
cmake	feat: NIXL interface integration (#3934)	2025-05-19 18:18:22 +08:00
include/tensorrt_llm	fix: [nvbugs/5287097] Align PP layer distribution between pytorch and TRT flow. (#4399)	2025-05-19 14:25:36 -07:00
kernels	[Feat] add chunked-attention kernels on Hopper (for llama4) (#4291)	2025-05-19 09:57:10 -07:00
micro_benchmarks	feat: support add internal cutlass kernels as subproject (#3658)	2025-05-06 11:35:07 +08:00
tensorrt_llm	feat: large-scale EP(part 2: MoE Load Balancer - core utilities) (#4384)	2025-05-20 17:53:48 +08:00
tests	feat: large-scale EP(part 2: MoE Load Balancer - core utilities) (#4384)	2025-05-20 17:53:48 +08:00
CMakeLists.txt	fix: better method to help torch find nvtx3 (#4110)	2025-05-15 16:42:30 +08:00
conandata.yml	infra: add conan (#3744)	2025-04-30 11:53:14 -07:00
conanfile.py	infra: add conan (#3744)	2025-04-30 11:53:14 -07:00