How to Configure Vertex AI with Continue

Enable the Vertex AI API and set up Google Application Default Credentials

Configuration

YAML

config.yaml

name: My Config
version: 0.0.1
schema: v1

models:
  - name: <MODEL_NAME>
    provider: vertexai
    model: <MODEL_ID>
    env:
      projectId: <PROJECT_ID>
      region: us-east5

JSON (Deprecated)

config.json

{
  "models": [
    {
      "title": "<MODEL_NAME>",
      "provider": "vertexai",
      "model": "<MODEL_ID>",
      "projectId": "[PROJECT_ID]",
      "region": "us-east5"
    }
  ]
}

How to Enable Vertex AI Express Mode

You can use Vertex AI in express mode by only providing an API Key. Only some Gemini models are supported in express mode for now.

YAML

config.yaml

name: My Config
version: 0.0.1
schema: v1

models:
  - name: <MODEL_NAME>
    provider: vertexai
    model: <MODEL_ID>
    apiKey: <YOUR_GOOGLE_CLOUD_API_KEY>

JSON (Deprecated)

config.json

{
  "models": [
    {
      "title": "<MODEL_NAME>",
      "provider": "vertexai",
      "model": "<MODEL_ID>",
      "apiKey": "<YOUR_GOOGLE_CLOUD_API_KEY>",
    }
  ]
}