kanshan/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-07-06 11:10:21 +00:00
Code Issues Packages Projects Releases Wiki Activity
159 Commits 613 Branches 6,730 Tags
tcp_server
Commit Graph

56 Commits

Author SHA1 Message Date
beiller 129c7d1ea8 Add repetition penalty (#20) 
* Adding repeat penalization

* Update utils.h

* Update utils.cpp

* Numeric fix

Should probably still scale by temp even if penalized

* Update comments, more proper application

I see that numbers can go negative so a fix from a referenced commit

* Minor formatting

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2023-03-12 11:27:42 +02:00
Georgi Gerganov 7d9ed7b25f Bump memory buffer 2023-03-11 12:45:01 +02:00
Georgi Gerganov 007a8f6f45 Support all LLaMA models + change Q4_0 quantization storage 2023-03-11 11:28:30 +02:00
Georgi Gerganov 70bc0b8b15 Fix a bug in the rope calculation 2023-03-10 23:46:57 +02:00
Georgi Gerganov 319cdb3e1f Final touches 2023-03-10 21:50:46 +02:00
Georgi Gerganov 26c0846629 Initial release 2023-03-10 20:56:40 +02:00