llama.cpp/examples/parallel at fa0e67782086a19d47f327d51a4be14a45e4b891 - llama.cpp - Gitea: Git with a cup of tea

kanshan/llama.cpp

mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-07-10 13:10:22 +00:00

Files

T

History

Georgi Gerganov fa0e677820 llama : extend batch API to select which logits to output

2023-09-19 00:24:13 +03:00

..

CMakeLists.txt

parallel : example for serving multiple users in parallel

2023-09-18 20:37:28 +03:00

parallel.cpp

llama : extend batch API to select which logits to output

2023-09-19 00:24:13 +03:00