kanshan/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-07-06 03:00:23 +00:00
Code Issues Packages Projects Releases Wiki Activity
9,878 Commits 613 Branches 6,725 Tags

Default Branch

master

2da6686176 · Fix stale tensor-split params for draft models (#24814) · Updated 2026-07-05 18:39:36 +00:00
 ZIP  TAR.GZ

Branches

compilade/cuda-falcon-h1

1180752835 · cuda : support Falcon-H1 state size for SSM_SCAN · Updated 2025-07-09 16:18:37 +00:00    kanshan

4024
1
 ZIP  TAR.GZ
compilade/refactor-kv-cache

4d6a179c68 · gguf-py : avoid adding duplicate tensor mappings for Jamba · Updated 2025-07-09 15:58:35 +00:00    kanshan

4024
61
 ZIP  TAR.GZ
xsn/ggml_scale_bias

b7c6ece5b5 · ggml-ci · Updated 2025-07-09 12:13:34 +00:00    kanshan

4029
24
 ZIP  TAR.GZ
compilade/test-model-random

7634d14d7a · test-model-random : fix seq_id buffer overflow · Updated 2025-07-08 22:23:58 +00:00    kanshan

4029
18
 ZIP  TAR.GZ
compilade/fix-recurrent-batch-init

2ff3354c33 · memory : fix broken batch splits for recurrent cache · Updated 2025-07-08 01:23:14 +00:00    kanshan

4040
1
 ZIP  TAR.GZ
vb/add-smollm3

996195299e · up. · Updated 2025-07-07 21:42:40 +00:00    kanshan

4173
6
 ZIP  TAR.GZ
gg/metal-reuse-graphs

bf8b39015f · metal : reuse graphs · Updated 2025-07-07 18:37:07 +00:00    kanshan

4029
3
 ZIP  TAR.GZ
gg/kv-cache-prepare-separation

886da0a2c5 · kv-cache : prepare K/V buffers for separation · Updated 2025-07-04 07:13:16 +00:00    kanshan

4040
1
 ZIP  TAR.GZ
gg/llama-high-throughput-rebase

dfceb012ee · llama : add "virtual sequences" · Updated 2025-07-02 17:26:55 +00:00    kanshan

4051
8
 ZIP  TAR.GZ
compilade/mamba2

71bef66591 · cuda : graceful fallback for Mamba-1 models with weird embd size · Updated 2025-07-02 07:49:36 +00:00    kanshan

4060
44
 ZIP  TAR.GZ
gg/llama-high-throughput-save2

6179578988 · batch : require non-coupled batch with sequential split_equal · Updated 2025-06-25 14:20:46 +00:00    kanshan

4117
29
 ZIP  TAR.GZ
gg/llama-high-throughput-save

37bdfbef8c · wip 3 · Updated 2025-06-24 08:04:18 +00:00    kanshan

4117
21
 ZIP  TAR.GZ
gg/metal-fix-thread-safety

ae96333923 · metal : fix thread-safety · Updated 2025-06-20 13:42:54 +00:00    kanshan

4143
1
 ZIP  TAR.GZ
gg/repack-fix-wsize

6fb2f2e8a9 · ggml : fix repack work size for mul_mat_id · Updated 2025-06-20 07:34:16 +00:00    kanshan

4146
1
 ZIP  TAR.GZ
gabe-l-hart/HybridRecurrentCache

59fee24c72 · recurrent : rework graph inputs + add TODOs · Updated 2025-06-18 06:29:51 +00:00    kanshan

4170
31
 ZIP  TAR.GZ
add-pidfile

d3d06debe3 · server : add pidfile option · Updated 2025-06-17 20:47:53 +00:00    kanshan

4171
1
 ZIP  TAR.GZ
gg/server-reenable-swa-spec

36fce98281 · server : re-enable swa speculative decoding · Updated 2025-06-12 08:51:15 +00:00    kanshan

4214
1
 ZIP  TAR.GZ
gg/batch-simplify-output

ed99a8ea04 · cont : fix comments · Updated 2025-06-12 07:43:55 +00:00    kanshan

4217
3
 ZIP  TAR.GZ
compilade/fix-batch-reserve-rwkv

4b6fb6524b · context : round n_tokens to next multiple of n_seqs when reserving · Updated 2025-06-11 20:19:17 +00:00    kanshan

4220
1
 ZIP  TAR.GZ
compilade/readonly-recurrent-inputs

62a9f34bae · llama-graph : fix recurrent state copy · Updated 2025-06-10 04:26:30 +00:00    kanshan

4244
3
 ZIP  TAR.GZ