Files
llama.cpp/src
liminfei-amd a4107133a6 llama : add guard for K/V rotation input when buffer is unallocated (#25215)
llm_graph_input_attn_kv::set_input and llm_graph_input_attn_kv_iswa::set_input
call set_input_k_rot / set_input_v_rot whenever the rotation tensor pointer is
non-null, but the tensor's buffer can be unallocated (NULL) when a graph only
stores K/V without attending -- e.g. DFlash speculative decoding's KV-injection
pass. set_input_k_rot then calls ggml_backend_buffer_is_host() on a NULL buffer
and aborts with GGML_ASSERT(buffer).

Guard the four k_rot/v_rot inputs with the same "&& ->buffer" check that the
adjacent kq_mask inputs already use in these two functions. When the buffer is
unallocated there is no data to upload, so skipping is correct.

Fixes #25191

Signed-off-by: liminfei-amd <91481003+liminfei-amd@users.noreply.github.com>
2026-07-04 22:37:38 +02:00
..
2026-06-29 16:58:51 +08:00
2026-06-29 16:58:51 +08:00
2026-06-29 16:58:51 +08:00
2026-06-29 16:58:51 +08:00
2026-06-29 16:58:51 +08:00
2026-06-29 16:58:51 +08:00
2026-06-29 16:58:51 +08:00
2026-06-29 16:58:51 +08:00
2026-06-29 16:58:51 +08:00
2026-06-29 16:58:51 +08:00
2026-06-29 16:58:51 +08:00
2026-06-29 16:58:51 +08:00
2026-06-07 20:50:54 +08:00
2026-04-03 10:33:03 +02:00