William Zhang 2dd3ebf037 [#9150][feat] Add code for nano v3 to custom implementation in AD (#9465) ... * Why? We would like to show an alternative to monkey-patching in AutoDeploy. * What? This commit builds on the existing custom model implementation for NemotronH and adds the bits relevant for MoE layers. Part of #9150. Signed-off-by: William Zhang <133824995+2ez4bz@users.noreply.github.com>		2025-12-02 08:56:44 -08:00
..
_torch	[#9150][feat] Add code for nano v3 to custom implementation in AD (#9465)	2025-12-02 08:56:44 -08:00
api_stability	[TRTLLM-9488][feat] use FlashInfer.sampling by default (#9545)	2025-12-02 16:29:55 +08:00
bindings	[TRTLLM-8684][chore] Migrate BuildConfig to Pydantic, add a Python wrapper for KVCacheType enum (#8330)	2025-10-28 09:17:26 -07:00
disaggregated	[TRTLLM-7843][feat] implement disagg cluster auto-scaling (#8215)	2025-10-21 17:25:07 -04:00
executor	[TRTLLM-9144][fix] enhance RPC robustness (#8711)	2025-12-02 21:37:59 +08:00
llmapi	[TRTLLM-9144][fix] enhance RPC robustness (#8711)	2025-12-02 21:37:59 +08:00
others	[None][feat] Add disagg relay time to time breakdown tool (#8465)	2025-10-30 18:21:45 -07:00
scaffolding	[None][feat] Refactor scaffolding streaming feature and fix openai wo… (#8622)	2025-10-30 16:02:40 +08:00
tools	[None][feat] Add a parser to layer-wise benchmarks (#9440)	2025-11-25 05:45:16 -08:00
trt	[TRTLLM-8682][chore] Remove auto_parallel module (#8329)	2025-10-22 20:53:08 -04:00
utils	[TRTLLM-8376][feat] top-p optimization (removes redundant softmax) (#9411)	2025-11-25 18:46:48 +01:00
conftest.py	[None][feat] Add Qwen3-Next to layer-wise benchmarks (#9065)	2025-11-14 10:03:00 +08:00
dump_checkpoint_stats.py	Update TensorRT-LLM (#2936)	2025-03-18 21:25:19 +08:00
gc_utils.py	[nvbug 5273941] fix: broken cyclic reference detect (#5417)	2025-07-01 20:12:55 +08:00
profile_utils.py	Update TensorRT-LLM (#2936)	2025-03-18 21:25:19 +08:00
pytest.ini	[https://nvbugs/5608461][fix] exclude InductorSubproc from thread leak check (#8704)	2025-10-30 15:35:15 +08:00
test_model_runner_cpp.py	Update TensorRT-LLM (#2936)	2025-03-18 21:25:19 +08:00
test_pip_install.py	[https://nvbugs/5616189][fix] Make more cases use local cached models (#8935)	2025-11-11 03:14:05 -08:00