kanshan/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-06-30 08:10:20 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
b6790
llama.cpp/tools
T
History
Radoslav Gerganov 41386cf365 rpc : report actual free memory (#16616) 
* rpc : report actual free memory

Start reporting the free memory on every device instead of using
fixed values. Now llama-cli users can get a nice memory breakdown
when using RPC devices.

* drop --mem in rpc-server
2025-10-17 18:02:52 +03:00
..
batched-bench
cmake : Do not install tools on iOS targets (#15903)
2025-09-16 09:54:44 +07:00
cvector-generator
cmake : Do not install tools on iOS targets (#15903)
2025-09-16 09:54:44 +07:00
export-lora
cmake : Do not install tools on iOS targets (#15903)
2025-09-16 09:54:44 +07:00
gguf-split
ci : use smaller model (#16168)
2025-09-22 09:11:39 +03:00
imatrix
cmake : Do not install tools on iOS targets (#15903)
2025-09-16 09:54:44 +07:00
llama-bench
llama : add --no-host to disable host buffers (#16310)
2025-10-06 19:55:53 +02:00
main
llama-cli: prevent spurious assistant token (#16202)
2025-09-29 10:03:12 +03:00
mtmd
mtmd : support home-cooked Mistral Small Omni (#14928)
2025-10-16 19:00:31 +02:00
perplexity
perplexity : show more kl-divergence data (#16321)
2025-09-29 09:30:45 +03:00
quantize
ci : use smaller model (#16168)
2025-09-22 09:11:39 +03:00
rpc
rpc : report actual free memory (#16616)
2025-10-17 18:02:52 +03:00
run
common: introduce http.h for httplib-based client (#16373)
2025-10-01 20:22:18 +03:00
server
webui: reorganize settings layout (#16607)
2025-10-17 10:35:03 +02:00
tokenize
cmake : Do not install tools on iOS targets (#15903)
2025-09-16 09:54:44 +07:00
tts
model : Apertus model implementation (#15852)
2025-10-02 20:43:22 +03:00
CMakeLists.txt
mtmd : rename llava directory to mtmd (#13311)
2025-05-05 16:02:55 +02:00