TensorRT-LLMs/tests/unittest
Gal Hubara-Agam b2095aa074
[#4674][bugfix] AutoDeploy Fix memory leak in fuse_moe (#7844)
Delete the unstacked weights immediately to save GPU memory, cleanup occurs automatically after the transformation, but for large models we'll run out of memory during the transformation itself.

Signed-off-by: Gal Hubara Agam <96368689+galagam@users.noreply.github.com>
2025-09-29 11:01:07 +03:00
..
_torch [#4674][bugfix] AutoDeploy Fix memory leak in fuse_moe (#7844) 2025-09-29 11:01:07 +03:00
api_stability [None][fix] api stability bug in status label (#7861) 2025-09-25 21:02:35 +08:00
bindings [TRTLLM-7028][feat] Enable guided decoding with speculative decoding (part 2: one-model engine) (#6948) 2025-09-03 15:16:11 -07:00
disaggregated feat: Dynamically remove servers in PD (#5270) 2025-06-25 09:50:04 +08:00
executor [TRTLLM-8188][chore] refactor GenerationExecutorWorker with WorkerBase for better code reusing (#7840) 2025-09-20 06:24:22 -07:00
llmapi [https://nvbugs/5427043][fix] cherrypick: request length exceeds max_num_tokens (#7718) 2025-09-25 21:02:35 +08:00
others [None][chroe] Rename TensorRT-LLM to TensorRT LLM for source code. (#7851) 2025-09-25 21:02:35 +08:00
scaffolding [https://nvbugs/5387375] fix(scaffolding): fix scaffolding aime test in test_e2e (#6140) 2025-07-18 10:34:37 +08:00
tools [None][infra] Waive failed cases for main on 0929 (#8053) 2025-09-29 02:46:02 -04:00
trt [None][chroe] Rename TensorRT-LLM to TensorRT LLM for source code. (#7851) 2025-09-25 21:02:35 +08:00
utils [TRTLLM-7070][feat] add gpt-oss serve benchmark tests (#7638) 2025-09-16 16:39:31 +08:00
conftest.py [TRTLLM-7457][ci] Update & cleanup unittest parallel config (#7254) 2025-08-27 00:45:58 -04:00
dump_checkpoint_stats.py Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
gc_utils.py [nvbug 5273941] fix: broken cyclic reference detect (#5417) 2025-07-01 20:12:55 +08:00
profile_utils.py Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
pytest.ini [None][ci] set TORCHINDUCTOR_COMPILE_THREADS for thop/parallel tests (#7489) 2025-09-04 06:04:51 -07:00
test_model_runner_cpp.py Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
test_pip_install.py [TRTLLM-7989][infra] Bundle UCX and NIXL libs in the TRTLLM python package (#7766) 2025-09-22 16:43:35 +08:00