kanshan/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-07-01 00:30:21 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
b6356
llama.cpp/ggml
T
History
hipudding 9961d244f2 CANN: Resolve soft_max precision issue (#15730) 
Previously, the slope tensor was set to fp16 to improve efficiency.
While this worked correctly in FA, it caused precision issues in soft_max.
This change applies different data types for different operators
to balance both accuracy and performance.
2025-09-02 17:12:37 +08:00
..
cmake
ggml: Skip backend library linking code when GGML_BACKEND_DL=ON (#15094)
2025-08-07 13:45:41 +02:00
include
llama : separate compute buffer reserve from fattn check (#15696)
2025-08-31 15:49:03 +02:00
src
CANN: Resolve soft_max precision issue (#15730)
2025-09-02 17:12:37 +08:00
.gitignore
vulkan : cmake integration (#8119)
2024-07-13 18:12:39 +02:00
CMakeLists.txt
ggml: update kleidiai to v1.13.0 (#15663)
2025-08-31 00:03:42 +08:00