Using Instinct with Ollama in Continue

Learn how to run Instinct, Continue’s leading open Next Edit model, on your own hardware with Ollama

Instinct is a 7 billion parameter model. You should expect slow responses if running on a laptop. To learn how to inference Instinct on a GPU, see our HuggingFace model card.

We recently released Instinct, a state-of-the-art open Next Edit model. Robustly fine-tuned from Qwen2.5-Coder-7B, Instinct intelligently predicts your next move to keep you in flow. To learn more about the model, check out our blog post.

1. Install Ollama

If you haven’t already installed Ollama, see our guide here.

2. Download Instinct

ollama run nate/instinct

3. Update your config.yaml

Open your config.yaml and add Instinct to the models section:

# ... rest of config.yaml ...

models:
  - uses: continuedev/instinct

Alternatively, you can just click to add the block at https://continue.dev/continuedev/instinct.