kanshan/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-06-30 00:00:23 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
master-bac6699
llama.cpp/common
T
History
slaren 1123f7fbdf ggml-cuda : use graph allocator (#2684) 
use a different function for no_alloc to avoid breaking backwards compat, fixes lora

remove 512 n_batch limit

fixed 2048 batch size

cleanup

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>
2023-08-22 15:25:19 +02:00
..
CMakeLists.txt
gguf : new file format with flexible meta data (beta) (#2398)
2023-08-21 23:07:43 +03:00
common.cpp
ggml-cuda : use graph allocator (#2684)
2023-08-22 15:25:19 +02:00
common.h
gguf : new file format with flexible meta data (beta) (#2398)
2023-08-21 23:07:43 +03:00
console.cpp
gguf : new file format with flexible meta data (beta) (#2398)
2023-08-21 23:07:43 +03:00
console.h
gguf : new file format with flexible meta data (beta) (#2398)
2023-08-21 23:07:43 +03:00
grammar-parser.cpp
gguf : new file format with flexible meta data (beta) (#2398)
2023-08-21 23:07:43 +03:00
grammar-parser.h
gguf : new file format with flexible meta data (beta) (#2398)
2023-08-21 23:07:43 +03:00