mirror of
https://github.com/ggml-org/llama.cpp.git
synced 2026-07-04 02:00:23 +00:00
014dca49d6
* CUDA: manage NCCL communicators in context * add check that all backends are CUDA * remove unused vector, limit init to > 1 GPUs * fix warnings * fix cuda device, cache allreduce