llama.cpp/examples/speculative at e1067efbfa0895115cc639ead8b22cdceef4eca1 - llama.cpp - Gitea: Git with a cup of tea

kanshan/llama.cpp

mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-07-05 10:40:25 +00:00

Files

T

History

Georgi Gerganov 4b5f3cd6bf parallel : process system prompt once + configurable paramters + llama API

2023-09-19 17:00:42 +03:00

..

CMakeLists.txt

speculative : PoC for speeding-up inference via speculative sampling (#2926 )

2023-09-03 15:12:08 +03:00

speculative.cpp

parallel : process system prompt once + configurable paramters + llama API

2023-09-19 17:00:42 +03:00