TensorRT-LLMs/cpp/tensorrt_llm
Pamela Peng 6cdfc54883
feat: Add FP8 support for SM 120 (#3248)
* Allow FP8 on SM120

Signed-off-by: Pamela Peng <179191831+pamelap-nvidia@users.noreply.github.com>

* fix sm121

Signed-off-by: Pamela Peng <179191831+pamelap-nvidia@users.noreply.github.com>

* fix

Signed-off-by: Pamela Peng <179191831+pamelap-nvidia@users.noreply.github.com>

* fix pre-commit

Signed-off-by: Pamela Peng <179191831+pamelap-nvidia@users.noreply.github.com>

* review update

Signed-off-by: Pamela Peng <179191831+pamelap-nvidia@users.noreply.github.com>

---------

Signed-off-by: Pamela Peng <179191831+pamelap-nvidia@users.noreply.github.com>
Co-authored-by: Sharan Chetlur <116769508+schetlur-nv@users.noreply.github.com>
2025-04-14 16:05:41 -07:00
..
batch_manager chore: Clean up cpp runtime (#3505) 2025-04-14 18:00:03 +08:00
common feat: Add FP8 support for SM 120 (#3248) 2025-04-14 16:05:41 -07:00
cutlass_extensions/include/cutlass_extensions feat: Update cutlass (#2981) 2025-03-26 22:36:27 +08:00
executor chore: exchange connection id with tagSend/tagRecv (#3320) 2025-04-14 09:30:34 +08:00
executor_worker Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
kernels feat: Add FP8 support for SM 120 (#3248) 2025-04-14 16:05:41 -07:00
layers fix: Eagle decoding (#3456) 2025-04-11 22:06:38 +08:00
plugins feat: Add FP8 support for SM 120 (#3248) 2025-04-14 16:05:41 -07:00
pybind chore: Clean up cpp runtime (#3505) 2025-04-14 18:00:03 +08:00
runtime feat: Add numNodes to ParallelConfig (#3346) 2025-04-13 13:55:04 +02:00
thop Cache sin cos in model instead of global LRU cache. (#3378) 2025-04-14 11:19:09 +08:00
CMakeLists.txt infra: move nvrtc_wrapper to conan (#3282) 2025-04-15 05:31:01 +08:00