kanshan/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-07-09 20:50:21 +00:00
Code Issues Packages Projects Releases Wiki Activity
3,172 Commits 613 Branches 6,777 Tags
ee3a086fdf85a331c072ee3c8fbf974eb394c6c2
Commit Graph

3 Commits

Author SHA1 Message Date
Olivier Chafik f9cfd04bd4 address gbnf-validator unused fread warning (switched to C++ / ifstream) 2024-06-10 17:38:36 +01:00
Olivier Chafik cbaadc9294 grammars: 1.5x faster inference w/ complex grammars (vector reserves / reuses) (#6609) 
* grammars: reserve rejects & next candidates

* grammars: reuse new_stacks

* grammars: fix missing sig change in llama.h

* grammars: fix test (api changed)

* grammars: update gbnf-validator.cpp

* grammars: simpler syntax (no swap)
 2024-04-11 19:47:34 +01:00
Clint Herron 9b84ae1806 examples : add GBNF validator program (#5948) 
* Revising GBNF validator program to be much simpler.

* Changing from streams to using cstdio

* Adding final newline character.
 2024-04-04 10:44:28 +03:00