kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
0976360204
TensorRT-LLMs/tensorrt_llm/quantization
History
DylanChen-NV 1ac0566a93
fix: fix for cp > kvHeadNum (#3002) 
* fix for cp > kvHeadNum

Signed-off-by: Dylan Chen <191843203+DylanChen-NV@users.noreply.github.com>

* fix for None kv_head_num

Signed-off-by: Dylan Chen <191843203+DylanChen-NV@users.noreply.github.com>

---------

Signed-off-by: Dylan Chen <191843203+DylanChen-NV@users.noreply.github.com>
2025-03-26 12:39:02 +08:00
..
utils Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
__init__.py Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
functional.py Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
image_processing.py Update TensorRT-LLM (#2582) 2024-12-16 21:50:47 -08:00
layers.py fix: fix for cp > kvHeadNum (#3002) 2025-03-26 12:39:02 +08:00
mode.py Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
quantize_by_modelopt.py fix: fix for cp > kvHeadNum (#3002) 2025-03-26 12:39:02 +08:00
quantize.py Update (#2978) 2025-03-23 16:39:35 +08:00