AI Commons

Third-Party Client Configuration

AnythingLLM

Setting Value
LLM Provider Generic OpenAI
Base URL YOUR_BASE_URL
API Key Your API key
Chat Model Name Any model ID from /v1/models (e.g. gpt-4, a bot ULID, or claude-v4.6-sonnet)

Continue.dev

{
  "models": [
    {
      "title": "UCSB AI Commons",
      "provider": "openai",
      "model": "claude-v4.6-sonnet",
      "apiBase": "YOUR_BASE_URL",
      "apiKey": "your-api-key"
    }
  ]
}

GitHub Copilot (VS Code)

Prerequisites

Before beginning the setup, ensure your development environment meets the following requirements:

  • VS Code Version: 1.122 or later (which natively supports the custom endpoint vendor and Bring Your Own Key functionality).
  • Extensions: The official GitHub Copilot and GitHub Copilot Chat extensions must be installed and active.
  • Network Access: Ensure your machine has network connectivity to the AWS API Gateway URL specified in your endpoint configuration.

Configuration Steps

  1. Open the Command Palette in VS Code:
    • Windows/Linux: Ctrl + Shift + P
    • macOS: Cmd + Shift + P
  2. Type and select: Chat: Manage Language Models.
  3. In the Language Models editor view, click on Add Models.
  4. Select Custom Endpoint from the provider options list.
  5. Enter a Group Name for this endpoint (e.g., UCSB AI).
  6. Paste your custom internal API Key when prompted by the input box.
Warning: Do not paste your raw, plaintext API key directly into the JSON configuration file. VS Code securely stores your key in your operating system's native secret storage (like Keychain or Credential Manager) and dynamically references it using the automated token format: ${input:chat.lm.secret.[unique_id]}.
  1. Select Chat Completions (chat-completions) when prompted for the API schema type.
  2. VS Code will automatically open your global or workspace-specific chatLanguageModels.json configuration file.
  3. Replace the contents of the opened chatLanguageModels.json file with your verified JSON configuration below:
[
    {
        "name": "UCSB AI",
        "vendor": "customendpoint",
        "apiKey": "${input:chat.lm.secret.-149527b5}",
        "apiType": "chat-completions",
        "models": [
            {
                "id": "claude-v4.6-sonnet",
                "name": "UCSB-claude-v4.6-sonnet",
                "url": "YOUR_BASE_URL",
                "toolCalling": true,
                "vision": true,
                "maxInputTokens": 128000,
                "maxOutputTokens": 16000
            }
        ]
    }
]