TensorRT-LLMs/cpp/tensorrt_llm
Gabriel Wu 376731013d
feat: use NVRTC for DeepGEMM JIT compilation (#3239)
* feat: use NVRTC for DeepGEMM JIT compilation

Signed-off-by: Zihua Wu 

* fix: add license

Signed-off-by: Zihua Wu

* feat: store NVRTC JIT results in memory by default

Signed-off-by: Zihua Wu


* feat: refinement

Signed-off-by: Zihua Wu

* feat: refinement

Signed-off-by: Zihua Wu

* test: set timeout to 7200

Signed-off-by: Zihua Wu

---------

Signed-off-by: Zihua Wu
2025-04-07 20:29:23 +08:00
..
batch_manager chore: remove usernames from comments (#3291) 2025-04-05 13:44:28 +08:00
common feat: Add support for FP8 MLA on Hopper and Blackwell. (#3190) 2025-04-07 15:14:13 +08:00
cutlass_extensions/include/cutlass_extensions feat: Update cutlass (#2981) 2025-03-26 22:36:27 +08:00
executor ucx interface (#3306) 2025-04-07 08:44:34 +08:00
executor_worker Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
kernels feat: use NVRTC for DeepGEMM JIT compilation (#3239) 2025-04-07 20:29:23 +08:00
layers chore: remove usernames from comments (#3291) 2025-04-05 13:44:28 +08:00
plugins chore: remove usernames from comments (#3291) 2025-04-05 13:44:28 +08:00
pybind feat: support abort disconnected requests (#3214) 2025-04-07 16:14:58 +08:00
runtime chore: remove usernames from comments (#3291) 2025-04-05 13:44:28 +08:00
thop feat: Add support for FP8 MLA on Hopper and Blackwell. (#3190) 2025-04-07 15:14:13 +08:00
CMakeLists.txt [feat] open source fp8_blockscale_gemm (#3071) 2025-04-02 12:12:52 +08:00