Logo
Explore Help
Sign In
kanshan/llama.cpp
1
0
Fork 0
You've already forked llama.cpp
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-07-04 10:10:19 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
gg/soft-max-ext
llama.cpp/examples/speculative
T
History
Georgi Gerganov 1f5cd83275 examples : add readme files
2023-11-29 11:00:17 +02:00
..
CMakeLists.txt
build : link against build info instead of compiling against it (#3879)
2023-11-02 08:50:16 +02:00
README.md
examples : add readme files
2023-11-29 11:00:17 +02:00
speculative.cpp
speculative : fix prompt tokenization in speculative example (#4025)
2023-11-20 11:50:04 +02:00

README.md

llama.cpp/examples/speculative

Demonstartion of speculative decoding and tree-based speculative decoding techniques

More info:

  • https://github.com/ggerganov/llama.cpp/pull/2926
  • https://github.com/ggerganov/llama.cpp/pull/3624
Reference in New Issue View Git Blame Copy Permalink
Powered by Gitea Version: 1.26.2 Page: 114ms Template: 4ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API