kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-02-09 20:43:50 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
376731013d
TensorRT-LLMs/tests/unittest/_torch
History
Gabriel Wu 376731013d
feat: use NVRTC for DeepGEMM JIT compilation (#3239) 
* feat: use NVRTC for DeepGEMM JIT compilation

Signed-off-by: Zihua Wu 

* fix: add license

Signed-off-by: Zihua Wu

* feat: store NVRTC JIT results in memory by default

Signed-off-by: Zihua Wu


* feat: refinement

Signed-off-by: Zihua Wu

* feat: refinement

Signed-off-by: Zihua Wu

* test: set timeout to 7200

Signed-off-by: Zihua Wu

---------

Signed-off-by: Zihua Wu
2025-04-07 20:29:23 +08:00
..
auto_deploy test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
compilation Update (#2978) 2025-03-23 16:39:35 +08:00
modeling feat: no-cache attention in PyTorch workflow (#3085) 2025-04-05 01:54:32 +08:00
multi_gpu update FP4 quantize layout (#3045) 2025-04-03 13:13:54 -04:00
multi_gpu_modeling chore: refactor the LlmArgs with Pydantic and migrate remaining pybinding configs to python (#3025) 2025-04-05 13:31:48 +08:00
speculative chore: refactor the LlmArgs with Pydantic and migrate remaining pybinding configs to python (#3025) 2025-04-05 13:31:48 +08:00
thop perf: Add optimizations for deepseek in min latency mode (#3093) 2025-04-02 09:05:24 +08:00
deep_gemm_tests.py feat: use NVRTC for DeepGEMM JIT compilation (#3239) 2025-04-07 20:29:23 +08:00
helpers.py Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
pattern_watcher.py Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
test_attention_no_cache.py feat: no-cache attention in PyTorch workflow (#3085) 2025-04-05 01:54:32 +08:00
test_attention.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_autotuner.py Fix minor issues in test_autotuner.py and loose the cache check for test gemms. (#3261) 2025-04-03 18:24:08 +08:00
test_flashinfer_attention.py Update (#2978) 2025-03-23 16:39:35 +08:00
test_flashinfer_star_attn.py Update (#2978) 2025-03-23 16:39:35 +08:00
test_fp4_bmm_quantize.py update FP4 quantize layout (#3045) 2025-04-03 13:13:54 -04:00
test_fp4_gemm_quantize.py update FP4 quantize layout (#3045) 2025-04-03 13:13:54 -04:00
test_fp4_linear.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_fp8_block_scale_gemm.py feat: use NVRTC for DeepGEMM JIT compilation (#3239) 2025-04-07 20:29:23 +08:00
test_fp8_linear.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_fp8_quantize.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_fused_moe.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_moe_routing.py Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
test_moe.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_overlap_scheduler_input.json Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
test_overlap_scheduler.py Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
test_pytorch_model_engine.py Update (#2978) 2025-03-23 16:39:35 +08:00
test_resource_manager.py feat: Support PeftCacheManager in Torch (#3186) 2025-04-04 12:38:08 +08:00
test_vanilla_attention.py Update (#2978) 2025-03-23 16:39:35 +08:00