Skip to main content
Watch: I Built an AI App Without Leaving Databricks

Setup guide - Documented by Continue

Use Ollama in Continue

Continue has a native provider: ollama model entry in config.yaml; set the model to an Ollama model id and apiBase only if Ollama runs remotely.

Last verified 4 steps2 official sources

Steps

  1. Step 1.

    Pull a model in Ollama (model id from Ollama's docs).

    Terminal
    ollama pull qwen3.5
  2. Step 2.

    Add an Ollama model to your Continue config (YAML).

    YAML
    name: My Config
    version: 0.0.1
    schema: v1
    
    models:
      - name: <MODEL_NAME>
        provider: ollama
        model: <MODEL_ID>
        apiBase: http://<my endpoint>:11434 # if running a remote instance of Ollama
  3. Step 3.

    If tools or images do not work with a custom model name, set capabilities explicitly.

    YAML
    models:
      - name: <CUSTOM_MODEL_NAME>
        provider: ollama
        model: <CUSTOM_MODEL_ID>
        capabilities:
          - tool_use      # Enable if your model supports function calling
          - image_input   # Enable for vision models
  4. Step 4.

    If you see "Model requires more system memory", reduce contextLength.

    YAML
    models:
      - name: Deepseek R1
        provider: ollama
        model: deepseek-r1:latest
        defaultCompletionOptions:
          contextLength: 2048

Caveats

  • Ollama's docs have no Continue page; config comes from Continue's docs, which use placeholders for the model id. The qwen3.5 model id is taken from Ollama's integration docs and combined here.
  • apiBase is only needed for a remote Ollama instance; the base URL shown is Ollama's documented default local endpoint.
  • Continue may set a higher default context length than other Ollama tools, which can cause the system memory error.

FAQ

How do I use Ollama in Continue?

Continue has a native provider: ollama model entry in config.yaml; set the model to an Ollama model id and apiBase only if Ollama runs remotely.

Which Ollama model ids work in Continue?

The official docs read for this guide list qwen3.5 and deepseek-r1:latest. Requests go to http://localhost:11434.

Is this an official Ollama and Continue setup?

Continue documents this setup in its own docs. It was last checked against 2 official pages on October 17, 2026.

Sources

Last verified against 2 official pages.

Newsletter

New models, set up the day they ship

One email per week. New model releases, the coding tools that support them and how to wire them up.