Ollama
Learn how to deploy an open source model with OpenAgent using Ollama.
Introduction
Ollama is a model deployment solution, it enables the quick deployment of many open source models. See: https://ollama.com.
OpenAgent uses Ollama to accelerate your deployment process.
When defining your MODEL_NAME in .env file, use the exact model name from https://ollama.com/library.
Model Compatibility
Theoretically, all models listed on https://ollama.com/library, are compatible with OpenAgent, with a varying degree of performance. Models that support function calling tend to have better overall performance. We have tested with a few models, see our evaluation results:
Compatible Models
Learn about the models compatible with OpenAgent.