Yukun He 5fa6fbd989 feat: Enhance AutoTuner inference path and code readability (#4466) ... Fix AutoTuner warmup request generating. * The current warmup phase creates one request, which is insufficient for the warmup to cover the max_num_tokens. Revise the warmup phase to a batch of requests to cover the max_num_tokens to eliminate potential fallback cases. Refactor AutoTuner API and reduce host overhead. Refine (min, opt, max) values of optimization profile setup for get_valid_tactics to achieve the correct canImplement definition. * Refine cache key assembly process to reduce host overhead and simplify API. * Fix lru_cache usage to reduce host overhead. * Move tuning config initialization as a one-time object in tunable runner to reduce host overhead. Improve tuning config readability. * Use dataclass to define tuning config. Signed-off-by: Yukun He <23156053+hyukn@users.noreply.github.com>		2025-06-04 10:53:11 +08:00
..
__init__.py	feat: Add group_rms_norm kernel to normalize multiple inputs in a single operator. (#3438)	2025-05-02 13:25:30 +08:00
cpp_custom_ops.py	[TRTLLM-4783][feat] Mamba2 kernel updates for Nemotron-H (#4494)	2025-06-01 13:56:44 +03:00
flashinfer_custom_ops.py	Cherry pick feat/llama4 to main (#4739)	2025-05-30 05:28:40 +08:00
torch_custom_ops.py	feat: Enhance AutoTuner inference path and code readability (#4466)	2025-06-04 10:53:11 +08:00
userbuffers_custom_ops.py	feat: Introduce UB allocator for pytorch flow (#3257)	2025-04-08 18:39:49 +08:00