Ollama is a tool that lets you run and interact with open source large language models (LLMs) on your local machine.

Models downloaded from the Ollama library can be configured and managed most easily with an elegant chat interface. We are working to make Apertus available here in the future.

As of the 0.12.6 release of Ollama, GGUF (a binary format for models) support for Apertus is available through community remixes. We have tested the following 8B releases by:

To get started, just run a command like this in your console where you have Ollama installed:

ollama pull hf.co/bartowski/swiss-ai_Apertus-8B-Instruct-2509-GGUF:Q4_K_M

Feel free to share your experiences with the community in the discussion area.