ollama-python/examples

Running Examples

Run the examples in this directory with:

# Ensure you are in the examples directory
cd examples/

# Run example
python3 <example>.py

Chat - Chat with a model

• chat.py
• async-chat.py
• chat-stream.py - Streamed outputs

Generate - Generate text with a model

• generate.py
• async-generate.py
• generate-stream.py - Streamed outputs

Tools/Function Calling - Call a function with a model

• tools.py - Simple example of Tools/Function Calling
• async-tools.py

Multimodal with Image - Chat with a multimodal (image chat) model

• multimodal_chat.py
• multimodal_generate.py

Ollama List - List all downloaded models and their properties

• list.py

Ollama ps - Show model status with CPU/GPU usage

• ps.py

Ollama Pull - Pull a model from Ollama

Requirement: pip install tqdm

• pull.py

Ollama Create - Create a model from a Modelfile

python create.py <model> <modelfile>

• create.py

See ollama/docs/modelfile.md for more information on the Modelfile format.

Ollama Embed - Generate embeddings with a model

• embed.py

Fill in the middle

• fill-in-middle.py - Given a prefix and suffix, fill in the middle