Providers

​

Quick Setup

1. Open Settings (Cmd+, / Ctrl+,)
2. Navigate to Providers
3. Expand any provider and enter your API key
4. Start using models from that provider

​

Supported Providers

​

Environment Variables

​

Advanced: Manual Configuration

{
  "anthropic": {
    "apiKey": "sk-ant-...",
    "baseUrl": "https://api.anthropic.com", // Optional custom endpoint
  },
  "openrouter": {
    "apiKey": "sk-or-v1-...",
    // Provider routing preferences
    "order": ["Cerebras", "Fireworks"],
    "allow_fallbacks": true,
  },
  "xai": {
    "apiKey": "sk-xai-...",
    // Search orchestration settings
    "searchParameters": { "mode": "auto" },
  },
  "bedrock": {
    "region": "us-east-1",
    // Uses AWS credential chain if no explicit credentials
  },
  "ollama": {
    "baseUrl": "http://your-server:11434/api", // Custom Ollama server
  },
}

​

OpenAI wire format

{
  "openai": {
    "baseUrl": "https://your-openai-gateway.example/v1",
    "wireFormat": "chatCompletions",
  },
}

​

Custom providers

{
  "local-vllm": {
    "providerType": "openai-compatible",
    "displayName": "Local vLLM",
    "baseUrl": "http://localhost:8000/v1",
    "models": ["qwen3-coder"],
  },
}

• openai-compatible and openai-responses: an origin-only URL such as http://localhost:8080 gains /v1. Explicit paths remain unchanged. A trailing slash, such as http://localhost:8080/, keeps requests at the origin root.
• anthropic-messages: trailing slashes are removed and /v1 is appended unless the URL already ends in /v1. For example, https://gateway.example/anthropic becomes https://gateway.example/anthropic/v1.

​

llama.cpp

{
  "llama-cpp": {
    "providerType": "openai-compatible",
    "displayName": "llama.cpp",
    "baseUrl": "http://localhost:8080/v1",
    "models": ["qwen3-coder"],
  },
}

​

vLLM

{
  "local-vllm": {
    "providerType": "openai-compatible",
    "displayName": "Local vLLM",
    "baseUrl": "http://localhost:8000/v1",
    "models": ["qwen3-coder"],
  },
}

​

LM Studio

{
  "lm-studio": {
    "providerType": "openai-compatible",
    "displayName": "LM Studio",
    "baseUrl": "http://localhost:1234/v1",
    "models": ["local-model"],
  },
}

• baseUrl is resolved from the Xum backend process. In desktop mode, this is your local machine. In server mode, the endpoint must be reachable from the server.
• Most compatible servers require the /v1 suffix in the URL. Use the normalization rules above when a gateway mounts its API under another path.
• Keep the official providers for provider-specific account features such as Codex OAuth and OpenAI service tiers. Custom providers select the request format but do not inherit those features.
• Custom providers are direct-only and do not participate in gateway routing.
• You no longer need to set a fake apiKey to point Xum at a keyless local server.

​

Coder (Login with Coder)

• The OAuth2 provider experiment: start coderd with --experiments=oauth2 (or CODER_EXPERIMENTS=oauth2)
• AI Gateway entitlement and --aibridge-enabled, with at least one provider configured

1. Open Settings → Providers → Coder
2. Set the Deployment URL (e.g. https://coder.example.com)
3. Click Login with Coder and approve the request in your browser

{
  "coder": {
    "additionalProviders": [{ "name": "llm-proxy", "type": "openai-compat" }],
    "models": ["llm-proxy/llama-3.3-70b"],
  },
}

​

Bedrock Authentication

1. Bearer Token - Single API key via bearerToken config or AWS_BEARER_TOKEN_BEDROCK env var
2. Explicit Credentials - accessKeyId + secretAccessKey in config
3. AWS Credential Chain - Automatic resolution from environment, ~/.aws/credentials, SSO, EC2/ECS roles

​

OpenRouter Provider Routing

• order: Priority list of providers (e.g., ["Cerebras", "Fireworks"])
• allow_fallbacks: Whether to try other providers if preferred ones are unavailable
• only / ignore: Restrict or exclude specific providers
• data_collection: "allow" or "deny" for training data policies

​

xAI Search Orchestration

​

Model Parameter Overrides

{
  "anthropic": {
    "apiKey": "sk-ant-...",
    "modelParameters": {
      // Override for a specific model
      "claude-sonnet-4-5": {
        "temperature": 0.7,
        "max_output_tokens": 16384,
      },
      // Wildcard default for all Anthropic models
      "*": {
        "max_output_tokens": 8192,
      },
    },
  },
}

​

Supported parameters

​

Resolution order

1. Effective model ID - a dated snapshot like claude-sonnet-4-5-20250929
2. Canonical model ID - the model you selected, e.g. claude-sonnet-4-5
3. Wildcard "*" - catch-all for that provider

​

Priority with other settings

1. Explicit per-message override (from thinking level or UI)
2. modelParameters config value
3. Model’s built-in default