Jinyang Yuan 992d513bc6 feat: Optionally split MoE inputs into chunks to reduce GPU memory usage (#3104) ... Signed-off-by: Jinyang Yuan <154768711+jinyangyuan-nvidia@users.noreply.github.com> Co-authored-by: raccoonliukai <raccoonliu@tencent.com>		2025-04-01 16:07:02 +08:00
..
__init__.py	Update (#2978)	2025-03-23 16:39:35 +08:00
.gitkeep	Update TensorRT-LLM (#2755)	2025-02-11 03:01:00 +00:00
modeling_auto.py	Add initial EAGLE-3 implementation (#3035)	2025-03-29 22:31:24 +08:00
modeling_bert.py	Refactor imports inside tensorrt_llm._torch. (#3015)	2025-03-26 11:01:07 +08:00
modeling_deepseekv3.py	feat: Optionally split MoE inputs into chunks to reduce GPU memory usage (#3104)	2025-04-01 16:07:02 +08:00
modeling_llama.py	Add initial EAGLE-3 implementation (#3035)	2025-03-29 22:31:24 +08:00
modeling_llava_next.py	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00
modeling_mamba_hybrid.py	Add initial EAGLE-3 implementation (#3035)	2025-03-29 22:31:24 +08:00
modeling_mixtral.py	feat: Optionally split MoE inputs into chunks to reduce GPU memory usage (#3104)	2025-04-01 16:07:02 +08:00
modeling_mllama.py	Update TensorRT-LLM (#2792)	2025-02-18 21:27:39 +08:00
modeling_multimodal_encoder.py	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00
modeling_multimodal_utils.py	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00
modeling_nemotron.py	Add initial EAGLE-3 implementation (#3035)	2025-03-29 22:31:24 +08:00
modeling_nvsmall.py	Update TensorRT-LLM (#2755)	2025-02-11 03:01:00 +00:00
modeling_qwen2vl.py	Update (#2978)	2025-03-23 16:39:35 +08:00
modeling_qwen.py	Add initial EAGLE-3 implementation (#3035)	2025-03-29 22:31:24 +08:00
modeling_utils.py	Chore: waive tests and fix multi-GPU tests (#3157)	2025-03-31 16:05:45 +08:00
modeling_vila.py	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00