mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-07-05 02:30:22 +00:00

Files

T

Georgi Gerganov 5261aee8d8 sampling : one sequence per sampling context

ggml-ci

2023-10-12 20:36:44 +03:00

CMakeLists.txt

2023-09-28 19:04:36 +03:00

parallel.cpp

2023-10-12 20:36:44 +03:00

README.md

2023-09-28 19:04:36 +03:00

llama.cpp/example/parallel

Simplified simluation for serving incoming requests in parallel