> ## Documentation Index
> Fetch the complete documentation index at: https://docs.gorbit.cloud/llms.txt
> Use this file to discover all available pages before exploring further.

# Ollama

> Using Ollama with Gorbit

## Guide

Configure Gorbit to use models served by [Ollama](https://ollama.com/).

<Steps>
  <Step title="Setup Ollama and Deploy your Models">
    The [Ollama GitHub repository](https://github.com/ollama/ollama?tab=readme-ov-file#ollama)
    details how to download and deploy models on Ollama.

    If self-hosting, Ollama is configured to run on port `11434` by default.

    You can also configure Gorbit to use [Ollama's managed cloud service](https://ollama.com/cloud).
  </Step>

  <Step title="Navigate to AI Model Configuration Page">
    Access the Admin Panel from your user profile icon → **Admin Panel** → **LLM**
  </Step>

  <Step title="Configure Ollama">
    Select **Ollama** from the available providers.

    Give your provider a **Display Name**.

    If using Ollama Cloud, enter your Ollama Cloud **API Key**.

    Click the **Fetch Available Models** button to see the models available in your Ollama instance.

    <img className="rounded-image" src="https://mintcdn.com/gorbit/i9pIrvFbh53KkrjR/assets/admins/ai_models/ollama_config.png?fit=max&auto=format&n=i9pIrvFbh53KkrjR&q=85&s=b48e3af84e3f37e2425efbe36cda65ee" alt="Ollama Provider Configuration" width="1778" height="1024" data-path="assets/admins/ai_models/ollama_config.png" />
  </Step>

  <Step title="Configure Default and Fast Models">
    The **Default Model** is selected automatically for new custom Agents and Chat sessions.

    Designating a **Fast Model** is optional.
    This **Fast Model** is used behind the scenes for quick operations such as evaluating the type of message,
    generating different queries (query expansion), and naming the chat session.

    <Tip>
      If you select a Fast Model,
      make sure it is a relatively quick and cost-effective model like GPT-4.1-mini or Claude 3.7 Sonnet.
    </Tip>
  </Step>

  <Step title="Choose Visible Models">
    In the **Advanced Options**, you will see a list of all models available from this provider.
    You may choose which models are visible to your users in Gorbit.

    Setting visible models is useful when a provider publishes multiple models and versions of the same model.
  </Step>

  <Step title="Designate Provider Access">
    Lastly, you may select whether or not the provider is public to all users in Gorbit.

    If set to private,
    the provider's models will be available to Admins and User Groups you explicitly assign the provider to.
  </Step>
</Steps>