TensorRT-LLMs/tensorrt_llm/quantization
Enwei Zhu c8cea3001a
fix: FP8 quantized lm_head (NvBug 5214229) (#3567)
Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com>
2025-04-17 15:18:34 +08:00
..
utils Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
__init__.py Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
functional.py feat: Add FP8 support for SM 120 (#3248) 2025-04-14 16:05:41 -07:00
image_processing.py Update TensorRT-LLM (#2582) 2024-12-16 21:50:47 -08:00
layers.py fix: Add missing parameter for WeightOnlyQuantRowLinear module (#2768) 2025-03-31 16:20:30 +08:00
mode.py Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
quantize_by_modelopt.py test:add fp8_kv_cache functionality test case. (#3457) 2025-04-15 09:16:46 +08:00
quantize.py fix: FP8 quantized lm_head (NvBug 5214229) (#3567) 2025-04-17 15:18:34 +08:00