mirror of https://github.com/coder/coder.git synced 2026-06-05 05:58:20 +00:00

Files

T

Atif Ali c21b3e49b3 docs: add client configuration section and support matrix for AI Bridge (#20640 )

Revised the AI Bridge documentation to clarify provider configuration
steps, including new sections for OpenAI, Anthropic, and Amazon Bedrock.
Added details on pre-configuring templates and using AI Bridge with
Coder Tasks. Introduced a new image illustrating the AI Bridge
implementation details. Updated compatibility notes for various AI
clients.

Addresses coder/aibridge#4

Preview:
https://coder.com/docs/@aibridge-client-instructions/ai-coder/ai-bridge

---------

Co-authored-by: david-fraley <67079030+david-fraley@users.noreply.github.com>
Co-authored-by: Danny Kopping <danny@coder.com>
Co-authored-by: David Fraley <davidiii@fraley.us>

2025-11-10 22:24:37 +00:00

2.7 KiB

Raw Blame History

Setup

AI Bridge runs inside the Coder control plane (coderd), requiring no separate compute to deploy or scale. Once enabled, coderd runs the aibridged in-memory and brokers traffic to your configured AI providers on behalf of authenticated users.

Required:

A premium licensed Coder deployment
Feature must be enabled using the server flag
One or more providers API key(s) must be configured

Activation

You will need to enable AI Bridge explicitly:

CODER_AIBRIDGE_ENABLED=true coder server
# or
coder server --aibridge-enabled=true

Configure Providers

AI Bridge proxies requests to upstream LLM APIs. Configure at least one provider before exposing AI Bridge to end users.

OpenAI

Set the following when routing OpenAI-compatible traffic through AI Bridge:

CODER_AIBRIDGE_OPENAI_KEY or --aibridge-openai-key
CODER_AIBRIDGE_OPENAI_BASE_URL or --aibridge-openai-base-url

The default base URL (https://api.openai.com/v1/) works for the native OpenAI service. Point the base URL at your preferred OpenAI-compatible endpoint (for example, a hosted proxy or LiteLLM deployment) when needed.

Anthropic

Set the following when routing Anthropic-compatible traffic through AI Bridge:

CODER_AIBRIDGE_ANTHROPIC_KEY or --aibridge-anthropic-key
CODER_AIBRIDGE_ANTHROPIC_BASE_URL or --aibridge-anthropic-base-url

The default base URL (https://api.anthropic.com/) targets Anthropic's public API. Override it for Anthropic-compatible brokers.

Amazon Bedrock

Set the following when routing Amazon Bedrock traffic through AI Bridge:

CODER_AIBRIDGE_BEDROCK_REGION or --aibridge-bedrock-region
CODER_AIBRIDGE_BEDROCK_ACCESS_KEY or --aibridge-bedrock-access-key
CODER_AIBRIDGE_BEDROCK_ACCESS_KEY_SECRET or --aibridge-bedrock-access-key-secret
CODER_AIBRIDGE_BEDROCK_MODEL or --aibridge-bedrock-model
CODER_AIBRIDGE_BEDROCK_SMALL_FAST_MODEL or --aibridge-bedrock-small-fast-model

Additional providers and Model Proxies

AI Bridge can relay traffic to other OpenAI- or Anthropic-compatible services or model proxies like LiteLLM by pointing the base URL variables above at the provider you operate. Share feedback or follow along in the aibridge issue tracker as we expand support for additional providers.

Note

See the Supported APIs section below for precise endpoint coverage and interception behavior.

2.7 KiB Raw Blame History