mirror of
https://github.com/ggml-org/llama.cpp.git
synced 2026-07-02 01:00:20 +00:00
0d28b16bdc
This commit introduces a sampling_info struct to encapsulate all backend sampling related data within the llama_context class. It also updates to use more descriptive names for sampled tokens and candidates in the backend sampler ggml data structure.