Yukun He 9c5b464fe0 [None][feat] Apply AutoTuner to fp8_block_scale_deep_gemm to trigger JIT ahead of time. (#7113) ... Because deep_gemm.gp8_gemm_nt will trigger many JIT processes during the inference phase, we need to sweep these shapes ahead of time. Apply the AutoTuner framework to achieve this and retain the potential capability to tune the swap_ab flag. Signed-off-by: Yukun He <23156053+hyukn@users.noreply.github.com>		2025-08-25 10:48:31 +08:00
..
attention_backend	[None][ci] move unittests to sub-directories (#6635)	2025-08-20 05:42:22 -04:00
auto_deploy	[None][chore] Enable auto deploy accuracy test in CI (#7179)	2025-08-24 08:42:30 -07:00
compilation	[None][refactor] Refactor Torch Compile Backend, MoeLoadBalancer and warmup Logic (#6615)	2025-08-19 09:58:44 +08:00
custom_ops	[None][feat] Apply AutoTuner to fp8_block_scale_deep_gemm to trigger JIT ahead of time. (#7113)	2025-08-25 10:48:31 +08:00
debug	Add debug hook to support dump tensor data and add new debug functions easily (#5182)	2025-06-24 17:45:28 +08:00
distributed	[https://nvbugs/5445466][fix] fix deepseek r1 hang by not enabling mnnvl by default (#6860)	2025-08-14 22:36:56 +08:00
models	[TRTLLM-6743][feat] Optimize and refactor alltoall in WideEP (#6973)	2025-08-24 08:15:29 -04:00
modules	[None][feat] Apply AutoTuner to fp8_block_scale_deep_gemm to trigger JIT ahead of time. (#7113)	2025-08-25 10:48:31 +08:00
peft	feat: support multi lora adapters and TP (#3885)	2025-05-08 23:45:45 +08:00
pyexecutor	[None][feat] Deepseek: Start Eagle work (#6210)	2025-08-22 12:57:17 -04:00
shared_tensor	[1/N][TRTLLM-5195][feat] Share PyTorch tensor between processes (#5396)	2025-07-10 05:12:53 +09:00
speculative	[None][feat] Deepseek: Start Eagle work (#6210)	2025-08-22 12:57:17 -04:00
__init__.py	[nvbugs/5401156][fix] Avoid import all models when import trtllm._common (#6266)	2025-07-27 23:29:21 -04:00
autotuner.py	[None][perf] Make finalize fusion part of the tactic selection logic (#6915)	2025-08-21 14:08:03 -07:00
expert_statistic.py	Add MTP support for Online EPLB (#5213)	2025-06-25 07:58:13 +08:00
flashinfer_utils.py	[None][ci] move unittests to sub-directories (#6635)	2025-08-20 05:42:22 -04:00
llm.py	[TRTLLM-5208][BREAKING CHANGE] chore: make pytorch LLM the default (#5312)	2025-06-20 03:01:10 +08:00
metadata.py	[None][feat] Use Separate QKV Input Layout for Context MLA (#6538)	2025-08-19 22:04:48 +08:00
model_config.py	[TRTLLM-7326][feat] Add standalone multimodal encoder (#6743)	2025-08-19 21:42:50 -07:00
utils.py	[None][refactor] Refactor Torch Compile Backend, MoeLoadBalancer and warmup Logic (#6615)	2025-08-19 09:58:44 +08:00
virtual_memory.py	[TRTLLM-4406][feat] LLM sleep & wakeup Part 1: virtual device memory (#5034)	2025-08-04 13:51:01 +08:00