This document explains how to set up **Continue.dev + Ollama** locally
on your computer, enabling VSCode with Cursor-like AI capabilities:
scanning projects, chatting, and modifying files.
## 1. Install Ollama
---
1. Download and install from [Ollama website](https://ollama.com/download) (macOS / Linux / Windows).
2. Verify installation:
``` bash
ollama --version
```
## 2. Install Models
---
1. Download the code-specialized model and an embedding model
``` bash
# Qwen 2.5 Coder 7B (code-focused model)
ollama pull qwen2.5-coder:7b
# Embedding model (used by Continue.dev for repo context)
ollama pull nomic-embed-text
```
## 3. Start Ollama Server
---
1. Start Ollama:
``` bash
ollama serve
```
or (macOS GUI)
``` bash
open -a Ollama
```
Test the API:
``` bash
curl http://127.0.0.1:11434/api/tags
```
## 4. Install Continue.dev
---
1. In VSCode, search for **Continue** in Extensions and install.\
2. Open the config file (usually `~/.continue/config.json`) and add:
``` json
{
"models": [
{
"title": "Qwen2.5 Coder (7B) - Local",
"provider": "ollama",
"model": "qwen2.5-coder:7b",
"apiBase": "http://127.0.0.1:11434"
}
],
"tabAutocompleteModel": {
"provider": "ollama",
"model": "qwen2.5-coder:7b",
"apiBase": "http://127.0.0.1:11434"
},
"embeddings": {
"provider": "ollama",
"model": "nomic-embed-text",
"apiBase": "http://127.0.0.1:11434"
},
"contextProviders": [
"file",
"directory",
"git",
"terminal",
"selection",
"codebase"
],
"allowAnonymousTelemetry": false
}
```
## 5. Verify the Model is Running
---
### Method 1: Ollama command
``` bash
ollama ps
```
### Expected output if running:
```bash
NAME ID SIZE STATUS
qwen2.5-coder:7b abcd123 4.7GB running
```
### Method 2: API test
``` bash
curl http://127.0.0.1:11434/api/generate -d
'{
"model": "qwen2.5-coder:7b",
"prompt": "hello world"
}'
```
### Method 3: System monitoring
- Check CPU and memory usage.
``` bash
ps aux | grep ollama
```
## 6. Usage
---
1. In VSCode, open Continue panel and select **Qwen2.5 Coder (7B) - Local**.
2. Type your request, for example: Modify src/utils/date.ts so parseDate supports both YYYY/MM/DD and ISO 8601.
3. Continue.dev will display a patch → click **Apply** to update the file.
4. For multi-file automatic edits → switch to **Agent Mode**.
## 7. Troubleshooting
---
- **Model not found**: Make sure the name is correct → `qwen2.5-coder:7b`.
- **Server not running**: Ensure `ollama serve` or GUI app is open.\
- **No response in Continue.dev**: Check `config.json` `apiBase`, use `127.0.0.1:11434`.
- **Too slow**: Try a smaller model, or upgrade to `qwen2.5-coder:14b`/ `llama3.1:8b`.