dongxuy04 16535991b2 feat: Add MNNVL MoE A2A support (#3504) ... * add MNNVL memory mapping support Signed-off-by: Dongxu Yang <78518666+dongxuy04@users.noreply.github.com> * add more MPI environment for trtllm-llmapi-launch Signed-off-by: Dongxu Yang <78518666+dongxuy04@users.noreply.github.com> * add MoE communication and prepare kernels Signed-off-by: Dongxu Yang <78518666+dongxuy04@users.noreply.github.com> * add MNNVL AlltoAll support for DeepSeekV3 Signed-off-by: Dongxu Yang <78518666+dongxuy04@users.noreply.github.com> * add output dump for throughput benchmark Signed-off-by: Dongxu Yang <78518666+dongxuy04@users.noreply.github.com> * support dynamic kernel launch grid Signed-off-by: Dongxu Yang <78518666+dongxuy04@users.noreply.github.com> * address review comments Signed-off-by: Dongxu Yang <78518666+dongxuy04@users.noreply.github.com> * address review comments #2 Signed-off-by: Dongxu Yang <78518666+dongxuy04@users.noreply.github.com> --------- Signed-off-by: Dongxu Yang <78518666+dongxuy04@users.noreply.github.com>		2025-04-25 17:29:08 +08:00
..
__init__.py	Update TensorRT-LLM (#2502)	2024-11-26 16:51:34 +08:00
configuration.py	Add smart router for moe (#3641)	2025-04-23 12:21:59 +08:00
engine.py	Update TensorRT-LLM (#2502)	2024-11-26 16:51:34 +08:00
enums.py	Update TensorRT-LLM (#2502)	2024-11-26 16:51:34 +08:00
general.py	feat: adding multimodal (only image for now) support in trtllm-bench (#3490)	2025-04-18 07:06:16 +08:00
reporting.py	feat: Add MNNVL MoE A2A support (#3504)	2025-04-25 17:29:08 +08:00
statistics.py	perf: Add total token throughput metric. (#3212)	2025-04-05 13:17:59 +08:00