Mike Iovine e534bf09cc [fix] Fix flashinfer + speculation issues (#3686) ... Signed-off-by: Mike Iovine <6158008+mikeiovine@users.noreply.github.com>		2025-04-28 14:34:22 -04:00
..
attention_backend	[fix] Fix flashinfer + speculation issues (#3686)	2025-04-28 14:34:22 -04:00
auto_deploy	fix: [AutoDeploy] update hf loading for e_score_correction_bias (#3847)	2025-04-26 02:03:47 +08:00
compilation	Unify two versions of AllReduce custom op (#3032)	2025-04-22 21:58:42 +08:00
custom_ops	feat: Add MNNVL MoE A2A support (#3504)	2025-04-25 17:29:08 +08:00
distributed	fix: Fix C++ decoder synchronization in PyTorch (#3106)	2025-04-23 23:55:27 +08:00
models	[fix] Fix flashinfer + speculation issues (#3686)	2025-04-28 14:34:22 -04:00
modules	[chore] Make llama4 MoE use maybe_execute_in_parallel (#3779)	2025-04-28 10:58:03 -04:00
peft	add passing E2E LoRA flow (#3788)	2025-04-23 18:38:06 +03:00
pyexecutor	[fix] Fix flashinfer + speculation issues (#3686)	2025-04-28 14:34:22 -04:00
speculative	[fix] Fix flashinfer + speculation issues (#3686)	2025-04-28 14:34:22 -04:00
__init__.py	Update TensorRT-LLM (#2755)	2025-02-11 03:01:00 +00:00
autotuner.py	feat: Apply the new torch-flow compatible AutoTuner to both Fused MoE and NVFP4 Linear operators. (#3151)	2025-04-08 14:28:36 +08:00
llm.py	test: [TRTLLM-4334] Create 1.0 criteria scope from API stability references (#3069)	2025-03-26 18:14:35 +08:00
metadata.py	feat: no-cache attention in PyTorch workflow (#3085)	2025-04-05 01:54:32 +08:00
model_config.py	fix bug of deepseek gropu_size setting (#3860)	2025-04-27 09:10:37 +08:00
pipeline_interface.py	Clean up modeling_deepseek.py (#3640)	2025-04-18 17:54:33 -07:00
utils.py	Cache sin cos in model instead of global LRU cache. (#3378)	2025-04-14 11:19:09 +08:00