TensorRT-LLMs/tensorrt_llm/layers
DylanChen-NV 1ac0566a93
fix: fix for cp > kvHeadNum (#3002)
* fix for cp > kvHeadNum

Signed-off-by: Dylan Chen <191843203+DylanChen-NV@users.noreply.github.com>

* fix for None kv_head_num

Signed-off-by: Dylan Chen <191843203+DylanChen-NV@users.noreply.github.com>

---------

Signed-off-by: Dylan Chen <191843203+DylanChen-NV@users.noreply.github.com>
2025-03-26 12:39:02 +08:00
..
__init__.py Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
activation.py Update TensorRT-LLM (#787) 2024-01-02 17:54:32 +08:00
attention.py fix: fix for cp > kvHeadNum (#3002) 2025-03-26 12:39:02 +08:00
cast.py Update TensorRT-LLM (#787) 2024-01-02 17:54:32 +08:00
conv.py Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
embedding.py Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
language_adapter.py Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
linear.py Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
lora.py Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
mlp.py Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
moe.py Update (#2978) 2025-03-23 16:39:35 +08:00
normalization.py Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
pooling.py Update TensorRT-LLM (#787) 2024-01-02 17:54:32 +08:00
recurrent.py Update TensorRT-LLM (#1954) 2024-07-16 15:30:25 +08:00
ssm.py Update TensorRT-LLM (#2562) 2024-12-11 00:31:05 -08:00