kanshan/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-06-30 16:20:20 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,175 Commits 608 Branches 6,703 Tags
b2175
Commit Graph

3 Commits

Author SHA1 Message Date
Xuan Son Nguyen 907e08c110 server : add llama2 chat template (#5425) 
* server: add mistral chat template

* server: fix typo

* server: rename template mistral to llama2

* server: format_llama2: remove BOS

* server: validate "--chat-template" argument

* server: clean up using_chatml variable

Co-authored-by: Jared Van Bortel <cebtenzzre@gmail.com>

---------

Co-authored-by: Jared Van Bortel <cebtenzzre@gmail.com>
 2024-02-11 12:16:22 +02:00
Georgi Gerganov 753eafed0e sync : ggml 2024-01-27 17:00:24 +02:00
Xuan Son Nguyen 48c857aa10 server : refactored the task processing logic (#5065) 
* server: add llama_server_queue struct

* server: add llama_server_response_event

* server: add comments

* server: move all mutexes away from server.cpp

* server: correct multitask response

* server: only add back deferred tasks when one slot is available

* server: fix a race condition cause by "request_completion"
 2024-01-26 14:42:20 +02:00