ollama-python/examples

Running Examples

Run the examples in this directory with:

# Run example
python3 examples/<example>.py

Chat - Chat with a model

• chat.py
• async-chat.py
• chat-stream.py - Streamed outputs
• chat-with-history.py - Chat with model and maintain history of the conversation

Generate - Generate text with a model

• generate.py
• async-generate.py
• generate-stream.py - Streamed outputs
• fill-in-middle.py - Given a prefix and suffix, fill in the middle

Tools/Function Calling - Call a function with a model

• tools.py - Simple example of Tools/Function Calling
• async-tools.py

Multimodal with Images - Chat with a multimodal (image chat) model

• multimodal_chat.py
• multimodal_generate.py

Structured Outputs - Generate structured outputs with a model

• structured-outputs.py
• async-structured-outputs.py
• structured-outputs-image.py

Tokenization - Tokenize and detokenize text with a model

• tokenization.py

Ollama List - List all downloaded models and their properties

• list.py

Ollama ps - Show model status with CPU/GPU usage

• ps.py

Ollama Pull - Pull a model from Ollama

Requirement: pip install tqdm

• pull.py

Ollama Create - Create a model from a Modelfile

python create.py <model> <modelfile>

• create.py

See ollama/docs/modelfile.md for more information on the Modelfile format.

Ollama Embed - Generate embeddings with a model

• embed.py