llama.cpp/examples/speculative at sampling-greedy-with-probs - llama.cpp - Gitea: Git with a cup of tea

kanshan/llama.cpp

mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-07-04 18:20:21 +00:00

Files

T

History

Georgi Gerganov bbfc62ac2f sampling : temp == 0.0 -> no probs, temp < 0.0 -> probs

2023-10-28 14:04:57 +03:00

..

CMakeLists.txt

speculative : PoC for speeding-up inference via speculative sampling (#2926 )

2023-09-03 15:12:08 +03:00

speculative.cpp

sampling : temp == 0.0 -> no probs, temp < 0.0 -> probs

2023-10-28 14:04:57 +03:00