> ## Documentation Index
> Fetch the complete documentation index at: https://docs.ag2.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Ollama

<img src="https://mintcdn.com/ag2ai/Ud6uRptdjz7Ptn7b/docs/ecosystem/img/ecosystem-ollama.png?fit=max&auto=format&n=Ud6uRptdjz7Ptn7b&q=85&s=71b75bc1b1749f7de57b6dddc5a8e8b4" alt="Ollama Example" width="234" height="204" data-path="docs/ecosystem/img/ecosystem-ollama.png" />

[Ollama](https://ollama.com/) allows the users to run open-source large language models, such as Llama 2, locally. Ollama bundles model weights, configuration, and data into a single package, defined by a Modelfile. It optimizes setup and configuration details, including GPU usage.

* [Ollama + AG2 instruction](https://ollama.ai/blog/openai-compatibility)

<div className="edit-url-container">
  <a className="edit-url" href="https://github.com/ag2ai/ag2/edit/main/website/docs/ecosystem/ollama.mdx" target="_blank"><Icon icon="pen" iconType="solid" size="13px" /> Edit this page</a>
</div>