Ruixiang Wang 689a9a470e server-bench : add speed-bench for speculative decoding benchmarking (#23869) ...

* spec: add speed-bench support for benchmarking

* speed-bench : add trailing newline to requirements.txt

* speed-bench : bump datasets to 4.8.0 to fix ty check

* server-bench : remove now-unused type: ignore after datasets bump

2026-05-29 23:09:47 +02:00

..

apple

scripts : make the shell scripts cross-platform (#14341)

2025-06-30 10:17:18 +02:00

hip

ggml-cuda: Add generic NVFP4 MMQ kernel (#21074)

2026-04-01 12:04:58 +02:00

jinja

ci : bump ty to 0.0.33 (#22535)

2026-04-30 16:15:54 +03:00

snapdragon

hexagon: basic/generic op fusion support and RMS_NORM+MUL fusion (#23835)

2026-05-28 14:05:54 -07:00

bench-models.sh

benches : update models + numbers (#19359)

2026-02-05 14:34:07 +02:00

build-info.sh

llama : reorganize source code + improve CMake (#8006)

2024-06-26 18:33:02 +03:00

check-requirements.sh

scripts : make the shell scripts cross-platform (#14341)

2025-06-30 10:17:18 +02:00

compare-commits.sh

scripts: add sqlite3 check for compare-commits.sh (#15633)

2025-08-28 19:23:22 +08:00

compare-llama-bench.py

llama-bench: add -fitc and -fitt to arguments (#21304)

2026-04-06 22:26:02 +08:00

compare-logprobs.py

scripts: update corpus of compare-logprobs (#19326)

2026-02-25 12:57:34 +01:00

create_ops_docs.py

Docs: add instructions for adding backends (#14889)

2025-07-27 09:36:43 +08:00

debug-test.sh

refactor : remove libcurl, use OpenSSL when available (#18828)

2026-01-14 18:02:47 +01:00

fetch_server_test_models.py

server: Add cached_tokens info to oaicompat responses (#19361)

2026-03-19 19:09:33 +01:00

gen-authors.sh

scripts : make the shell scripts cross-platform (#14341)

2025-06-30 10:17:18 +02:00

gen-unicode-data.py

ci : bump ty to 0.0.26 (#21156)

2026-03-30 09:29:15 +02:00

get_chat_template.py

scripts: corrected encoding when getting chat template (#11866) (#11907)

2025-02-18 10:30:16 +01:00

get-flags.mk

build : pass all warning flags to nvcc via -Xcompiler (#5570)

2024-02-18 16:21:52 -05:00

get-hellaswag.sh

scripts : update get-hellaswag.sh and get-winogrande.sh (#20542)

2026-03-14 11:21:50 +01:00

get-pg.sh

scripts : make the shell scripts cross-platform (#14341)

2025-06-30 10:17:18 +02:00

get-wikitext-2.sh

scripts : improve get-wikitext-2.sh (#19952)

2026-03-02 15:40:49 +01:00

get-winogrande.sh

scripts : update get-hellaswag.sh and get-winogrande.sh (#20542)

2026-03-14 11:21:50 +01:00

git-bisect-run.sh

llama: end-to-end tests (#19802)

2026-03-08 12:30:21 +01:00

git-bisect.sh

llama: end-to-end tests (#19802)

2026-03-08 12:30:21 +01:00

hf.sh

scripts : make the shell scripts cross-platform (#14341)

2025-06-30 10:17:18 +02:00

install-oneapi.bat

support SYCL backend windows build (#5208)

2024-01-31 08:08:07 +05:30

pr2wt.sh

pr2wt : symlink .pi (#22386)

2026-04-26 19:49:26 +03:00

serve-static.js

refactor : remove libcurl, use OpenSSL when available (#18828)

2026-01-14 18:02:47 +01:00

server-bench.py

server-bench : add speed-bench for speculative decoding benchmarking (#23869)

2026-05-29 23:09:47 +02:00

server-test-function-call.py

common/autoparser: fixes for newline handling / forced tool calls (#22654)

2026-05-04 13:18:11 +02:00

server-test-model.py

Autoparser - complete refactoring of parser architecture (#18675)

2026-03-06 21:01:00 +01:00

server-test-parallel-tc.py

chat: fix parallel_tool_calls default setting based on model capabilities, add tests for parallel tool calls and structured outputs (#22217)

2026-04-22 18:10:56 +02:00

server-test-structured.py

parser: fix structured output bug (#22302)

2026-04-24 23:19:55 +02:00

sync_vendor.py

vendor : update cpp-httplib to 0.46.0 (#23650)

2026-05-27 21:36:24 +08:00

sync-ggml-am.sh

scripts : update sync scripts

2025-08-18 22:06:44 +03:00

sync-ggml.last

sync : ggml

2026-05-29 09:56:08 +03:00

sync-ggml.sh

scripts : update sync scripts

2025-08-18 22:06:44 +03:00

tool_bench.py

refactor : remove libcurl, use OpenSSL when available (#18828)

2026-01-14 18:02:47 +01:00

tool_bench.sh

scripts : make the shell scripts cross-platform (#14341)

2025-06-30 10:17:18 +02:00

ui-assets.cmake

cmake/ui : refactor the build (#23352)

2026-05-23 17:08:22 -04:00

verify-checksum-models.py

convert.py : add python logging instead of print() (#6511)

2024-05-03 22:36:41 +03:00

wc2wt.sh

scripts : allow wc2wt with an existing branch (#23189)

2026-05-18 08:57:28 +03:00