mirror of
https://github.com/ggml-org/llama.cpp.git
synced 2026-06-25 13:50:20 +00:00
Julien Jerphanion
a1eb756c0b
* docs: Add instructions to install `llama.cpp` from conda-forge Signed-off-by: Julien Jerphanion <git@jjerphan.xyz> * Rewording of instructions Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> --------- Signed-off-by: Julien Jerphanion <git@jjerphan.xyz> Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
1.8 KiB
1.8 KiB
Install pre-built version of llama.cpp
| Install via | Windows | Mac | Linux |
|---|---|---|---|
| conda-forge | ✅ | ✅ | ✅ |
| Winget | ✅ | ||
| Homebrew | ✅ | ✅ | |
| MacPorts | ✅ | ||
| Nix | ✅ | ✅ |
conda-forge (Windows, Mac and Linux)
conda-forge provides builds for:
- CUDA (Windows and Linux)
- Vulkan (Windows and Linux)
- Apple Metal (macOS)
conda install -c conda-forge llama-cpp
mamba install -c conda-forge llama-cpp
# Project-local installation
pixi add llama-cpp
# Global installation
pixi global install llama-cpp
This distribution is managed on conda-forge/llama-cpp-feedstock.
Shall you have any problems, please open an issue on its issue tracker.
Winget (Windows)
winget install llama.cpp
The package is automatically updated with new llama.cpp releases. More info: https://github.com/ggml-org/llama.cpp/issues/8188
Homebrew (Mac and Linux)
brew install llama.cpp
The formula is automatically updated with new llama.cpp releases. More info: https://github.com/ggml-org/llama.cpp/discussions/7668
MacPorts (Mac)
sudo port install llama.cpp
See also: https://ports.macports.org/port/llama.cpp/details/
Nix (Mac and Linux)
nix profile install nixpkgs#llama-cpp
For flake enabled installs.
Or
nix-env --file '<nixpkgs>' --install --attr llama-cpp
For non-flake enabled installs.
This expression is automatically updated within the nixpkgs repo.