TensorRT-LLMs/tests/unittest/_torch
tomeras91 f0bfb49219
[https://nvbugs/5458874][fix] Fix Nemotron-H flaky CUDA graph / overlap scheduler test (#6996)
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
2025-08-19 15:45:06 +03:00
..
auto_deploy [https://nvbugs/5458798][fix] Relaxed test threshold, added documentation (#6997) 2025-08-19 00:24:03 -07:00
compilation [TRTLLM-3105][feat] Add Piecewise CUDA Graph Support (#3804) 2025-05-09 11:04:01 +08:00
debugger Fix: fix nvbug 5356427 (#5464) 2025-06-25 22:24:26 +08:00
modeling [https://nvbugs/5458874][fix] Fix Nemotron-H flaky CUDA graph / overlap scheduler test (#6996) 2025-08-19 15:45:06 +03:00
modules [None][refactor] Refactor Torch Compile Backend, MoeLoadBalancer and warmup Logic (#6615) 2025-08-19 09:58:44 +08:00
multi_gpu [TRTLLM-5966][feat] Helix: extend mapping to support different CP types (#6816) 2025-08-14 09:00:02 -07:00
multi_gpu_modeling [TRTLLM-7157][feat] BREAKING CHANGE Introduce sampler_type, detect sampler according to options (#6831) 2025-08-16 00:27:24 -04:00
multimodal [None][feat] Support SharedTensor on MultimodalParams (#6254) 2025-08-10 17:48:24 -07:00
speculative [TRTLLM-7157][feat] BREAKING CHANGE Introduce sampler_type, detect sampler according to options (#6831) 2025-08-16 00:27:24 -04:00
thop [TRTLLM-6960][fix] enable scaled_mm tests (#6936) 2025-08-19 10:18:04 +08:00
helpers.py [TRTLLM-5863][feat] Support MoE INT8 Weight-Only-Quantization in PyTorch Workflow (#6629) 2025-08-15 17:15:49 -04:00
pattern_watcher.py [TRTLLM-3105][feat] Add Piecewise CUDA Graph Support (#3804) 2025-05-09 11:04:01 +08:00
test_attention_mla.py [https://nvbugs/5451373][fix] : Fix the accuracy issue when using FP8 context MLA (#6881) 2025-08-15 16:53:56 +08:00
test_attention_no_cache.py refactor(test): remove random context sequence lengths and set seed for reproducibility in attention tests (#3919) 2025-04-29 10:08:04 +08:00
test_attention.py reduce num layers in attention test (#3509) 2025-04-14 12:43:59 +08:00
test_autotuner.py [TRTLLM-4501][feat] AutoTuner tuning config refactor and valid tactic generalization. (#6545) 2025-08-13 16:25:22 +08:00
test_beam_search.py [TRTLLM-6650][fix] Enhance CUDA graph + Beam search to correctly handle padding (#6665) 2025-08-08 14:00:33 +02:00
test_best_of_n.py [TRTLLM-6785][feat] BREAKING CHANGE Enable TRTLLM sampler by default (#6216) 2025-08-07 22:19:37 -04:00
test_custom_ops.py [None] [feat] Add model gpt-oss (#6645) 2025-08-07 03:04:18 -04:00
test_executor_request_queue.py [None][opt] Add batch wait timeout in fetching requests (#6923) 2025-08-19 03:50:08 -04:00
test_flashinfer_attention.py Add thread leak check and fix thread/memory leak issues. (#3270) 2025-04-08 19:03:18 +08:00
test_flashinfer_star_attn.py [TRTLLM-5966][feat] Helix: extend mapping to support different CP types (#6816) 2025-08-14 09:00:02 -07:00
test_fp8_per_tensor_scale_tllmg_gemm.py fix: [5328141] increase tolerance for test_fp8_block_scale_gemm (#5849) 2025-07-22 12:48:00 +08:00
test_group_rmn_norm.py feat: Add heuristic for GroupRMSNorm kernel selection. (#4047) 2025-05-13 08:52:53 +08:00
test_mnnvl_memory.py feat: Add MNNVL MoE A2A support (#3504) 2025-04-25 17:29:08 +08:00
test_overlap_scheduler_input.json refactor: Unify request order in TRT and PyTorch workflow (#4096) 2025-05-20 18:49:27 +02:00
test_overlap_scheduler.py [TRTLLM-7157][feat] BREAKING CHANGE Introduce sampler_type, detect sampler according to options (#6831) 2025-08-16 00:27:24 -04:00
test_pytorch_model_engine.py [TRTLLM-5493] Add core infrastructure to enable loading of custom checkpoint formats (#5372) 2025-07-17 00:50:30 +08:00
test_resource_manager.py [None][fix] Refactoring to avoid circular import when importing torch models (#6720) 2025-08-11 18:00:42 -04:00
test_return_logits.py [TRTLLM-7157][feat] BREAKING CHANGE Introduce sampler_type, detect sampler according to options (#6831) 2025-08-16 00:27:24 -04:00
test_share_tensor.py [1/N][TRTLLM-5195][feat] Share PyTorch tensor between processes (#5396) 2025-07-10 05:12:53 +09:00
test_trtllm_sampler.py [TRTLLM-6785][feat] BREAKING CHANGE Enable TRTLLM sampler by default (#6216) 2025-08-07 22:19:37 -04:00
test_vanilla_attention.py Add thread leak check and fix thread/memory leak issues. (#3270) 2025-04-08 19:03:18 +08:00
test_virtual_memory.py [TRTLLM-4406][feat] LLM sleep & wakeup Part 1: virtual device memory (#5034) 2025-08-04 13:51:01 +08:00