Xuan-Son Nguyen 721354fbdf server: (router) move model downloading to dedicated process (#24834) ...

* server: real-time model load progress tracking via /models/sse

* update docs

* server: move model download to child process

* rm unused

* fix most problems

* clean up

* nit fixes

* fix test case

* do not detact() thread

* shorter MODEL_DOWNLOAD_TIMEOUT in test

* throttle

2026-06-22 18:24:04 +02:00

..

jinja

jinja : implement call statement (#24847)

2026-06-21 14:04:52 +02:00

arg.cpp

server: (router) move model downloading to dedicated process (#24834)

2026-06-22 18:24:04 +02:00

arg.h

server: (router) move model downloading to dedicated process (#24834)

2026-06-22 18:24:04 +02:00

base64.hpp

llava : expose as a shared library for downstream projects (#3613)

2023-11-07 00:36:23 +03:00

build-info.cpp.in

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

build-info.h

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

chat-auto-parser-generator.cpp

common/peg : implement ac parser for stricter grammar generation (#24869)

2026-06-21 16:20:58 -05:00

chat-auto-parser-helpers.cpp

server: fix checkpoints creation (#22929)

2026-05-25 08:56:18 +03:00

chat-auto-parser-helpers.h

chat : avoid including json in chat.h (#21306)

2026-04-03 09:07:59 +03:00

chat-auto-parser.h

chat: harden peg-native tool call parsing (#24329)

2026-06-15 15:37:04 +02:00

chat-diff-analyzer.cpp

chat: harden peg-native tool call parsing (#24329)

2026-06-15 15:37:04 +02:00

chat-peg-parser.cpp

chat : fix LFM2 tool-call parsing double-escaping (#24667)

2026-06-15 22:10:09 +02:00

chat-peg-parser.h

chat: harden peg-native tool call parsing (#24329)

2026-06-15 15:37:04 +02:00

chat.cpp

chat: include full unparsed prompt in debug (#24650)

2026-06-15 17:33:54 +02:00

chat.h

server: fix checkpoints creation (#22929)

2026-05-25 08:56:18 +03:00

CMakeLists.txt

Move duplicated imatrix code into single common imatrix-loader.cpp (#22445)

2026-06-04 17:45:40 +02:00

common.cpp

mtmd, arg: fix utf8 handling on windows (#24779)

2026-06-19 22:28:38 +02:00

common.h

server: refactor child --> router communication (#24821)

2026-06-20 01:02:26 +02:00

console.cpp

cli: fix stripping of \n in multiline input (#21485)

2026-04-06 20:54:06 +02:00

console.h

cli : add command and file auto-completion (#19985)

2026-03-05 10:47:28 +01:00

debug.cpp

common: fix missing exports in llama-common (#22340)

2026-04-27 08:06:39 +03:00

debug.h

common: fix missing exports in llama-common (#22340)

2026-04-27 08:06:39 +03:00

download.cpp

server: (router) rework -hf preset repo (#24739)

2026-06-18 12:45:23 +02:00

download.h

server: (router) rework -hf preset repo (#24739)

2026-06-18 12:45:23 +02:00

fit.cpp

fit : wrap llama_device_memory_data (#24522)

2026-06-13 08:09:52 +03:00

fit.h

fit : wrap llama_device_memory_data (#24522)

2026-06-13 08:09:52 +03:00

hf-cache.cpp

server: (router) add model management API (#23976)

2026-06-17 18:04:58 +02:00

hf-cache.h

server: (router) add model management API (#23976)

2026-06-17 18:04:58 +02:00

http.h

server: Parse port numbers from MCP server URLs in CORS proxy (#20208)

2026-03-09 17:47:54 +01:00

imatrix-loader.cpp

Move duplicated imatrix code into single common imatrix-loader.cpp (#22445)

2026-06-04 17:45:40 +02:00

imatrix-loader.h

Move duplicated imatrix code into single common imatrix-loader.cpp (#22445)

2026-06-04 17:45:40 +02:00

json-partial.cpp

common : Generalized XML-style tool-call parsing with streaming support (GLM 4.5/4.6 + MiniMax M2 + SeedOSS + Kimi-K2 + Qwen3-Coder + Apriel-1.5 + Xiaomi-MiMo) (#16932)

2025-11-18 18:54:15 +01:00

json-partial.h

cli : fix reasoning responses in CLI (#18961)

2026-01-20 18:23:25 +01:00

json-schema-to-grammar.cpp

common/json-schema-to-grammar : align spacing rules with parsers (#24835)

2026-06-20 17:43:04 -05:00

json-schema-to-grammar.h

common : add nemotron 3 parsing (#18077)

2025-12-16 04:05:23 -06:00

llguidance.cpp

sampling : add support for backend sampling (#17004)

2026-01-04 22:22:16 +02:00

log.cpp

common: update logging to enforce max_capacity and optimize queue resizing (#24490)

2026-06-17 09:19:11 +03:00

log.h

logs : reduce (#23021)

2026-05-14 13:05:52 +03:00

ngram-cache.cpp

spec : add self‑speculative decoding (no draft model required) + refactor (#18471)

2026-01-28 19:42:42 +02:00

ngram-cache.h

spec : add self‑speculative decoding (no draft model required) + refactor (#18471)

2026-01-28 19:42:42 +02:00

ngram-map.cpp

llama : MTP clean-up (#23269)

2026-05-19 15:32:58 +03:00

ngram-map.h

fix: correct misspellings in code comments (#21217)

2026-03-31 13:50:51 +02:00

ngram-mod.cpp

ngram-mod : Add missing include (#23857)

2026-05-29 09:21:37 +03:00

ngram-mod.h

ngram-mod : fix build [no ci] (#19216)

2026-01-30 21:27:27 +02:00

peg-parser.cpp

common/peg : implement ac parser for stricter grammar generation (#24869)

2026-06-21 16:20:58 -05:00

peg-parser.h

common/peg : implement ac parser for stricter grammar generation (#24869)

2026-06-21 16:20:58 -05:00

preset.cpp

server: (router) rework -hf preset repo (#24739)

2026-06-18 12:45:23 +02:00

preset.h

server: (router) rework -hf preset repo (#24739)

2026-06-18 12:45:23 +02:00

reasoning-budget.cpp

common : support manually triggering the reasoning budget end sequence (#23949)

2026-06-01 11:37:11 +02:00

reasoning-budget.h

common : support manually triggering the reasoning budget end sequence (#23949)

2026-06-01 11:37:11 +02:00

regex-partial.cpp

common : fix iterator::end() dereference (#20445)

2026-03-16 08:50:38 +02:00

regex-partial.h

common: add partial regex support (#12808)

2025-05-14 19:50:57 +01:00

sampling.cpp

server : return HTTP 400 on invalid grammar (#24144) (#24154)

2026-06-18 12:49:14 +02:00

sampling.h

common : relax sampler name matching (#23744)

2026-06-07 22:48:11 +02:00

speculative.cpp

minor : clean-up whitespaces (#24862)

2026-06-21 11:37:12 +03:00

speculative.h

spec: support eagle3 for qwen3.5 & 3.6 (#24593)

2026-06-19 13:08:50 +03:00

unicode.cpp

common/parser: handle reasoning budget (#20297)

2026-03-11 10:26:12 +01:00

unicode.h

common/parser: handle reasoning budget (#20297)

2026-03-11 10:26:12 +01:00