Zongfei Jing c7548ad72c perf: Add optimizations for deepseek in min latency mode (#3093) ... * Add optimizations for deepseek min latency Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Fix compile error Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Update internal cutlass kernel libs Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Format code Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Resolve conflicts Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> --------- Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>		2025-04-02 09:05:24 +08:00
..
__init__.py	Update (#2978)	2025-03-23 16:39:35 +08:00
.gitkeep	Update TensorRT-LLM (#2755)	2025-02-11 03:01:00 +00:00
modeling_auto.py	Add initial EAGLE-3 implementation (#3035)	2025-03-29 22:31:24 +08:00
modeling_bert.py	Refactor imports inside tensorrt_llm._torch. (#3015)	2025-03-26 11:01:07 +08:00
modeling_deepseekv3.py	perf: Add optimizations for deepseek in min latency mode (#3093)	2025-04-02 09:05:24 +08:00
modeling_llama.py	Add initial EAGLE-3 implementation (#3035)	2025-03-29 22:31:24 +08:00
modeling_llava_next.py	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00
modeling_mamba_hybrid.py	Add initial EAGLE-3 implementation (#3035)	2025-03-29 22:31:24 +08:00
modeling_mixtral.py	feat: Optionally split MoE inputs into chunks to reduce GPU memory usage (#3104)	2025-04-01 16:07:02 +08:00
modeling_mllama.py	Update TensorRT-LLM (#2792)	2025-02-18 21:27:39 +08:00
modeling_multimodal_encoder.py	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00
modeling_multimodal_utils.py	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00
modeling_nemotron.py	Add initial EAGLE-3 implementation (#3035)	2025-03-29 22:31:24 +08:00
modeling_nvsmall.py	Update TensorRT-LLM (#2755)	2025-02-11 03:01:00 +00:00
modeling_qwen2vl.py	Update (#2978)	2025-03-23 16:39:35 +08:00
modeling_qwen.py	Add initial EAGLE-3 implementation (#3035)	2025-03-29 22:31:24 +08:00
modeling_utils.py	Chore: waive tests and fix multi-GPU tests (#3157)	2025-03-31 16:05:45 +08:00
modeling_vila.py	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00