TensorRT-LLMs/cpp
Chang Liu 1d3a5d38af
fix: Update FP8 sf layout for Blackwell and relax blockwise GEMM assertions (#3144)
* Update fp8 sf layout for blackwell and enable fp8 gemm e2e

* Add test case when m needs to be padded

* Better comment

Signed-off-by: Chang Liu <liuc@nvidia.com>

* Add TODO for fp8 quant kernel

Signed-off-by: Chang Liu <liuc@nvidia.com>

* Enable DCO check

Signed-off-by: Chang Liu <liuc@nvidia.com>

* Fix lint

---------

Signed-off-by: Chang Liu <liuc@nvidia.com>
2025-04-01 13:08:29 -07:00
..
cmake fix #3109: early exit cmake if find_library() does not find any lib (#3113) 2025-03-29 19:59:03 +08:00
include/tensorrt_llm refactor: Simplify disableLookahead and improve numDecodingEngineTokens handling (#3103) 2025-04-01 18:47:31 +08:00
micro_benchmarks Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
tensorrt_llm fix: Update FP8 sf layout for Blackwell and relax blockwise GEMM assertions (#3144) 2025-04-01 13:08:29 -07:00
tests refactor: Improve decoder finalize function (#3077) 2025-03-28 14:33:59 +08:00
CMakeLists.txt Update (#2978) 2025-03-23 16:39:35 +08:00