Files
coder/docs/ai-coder/ai-gateway/reference.md
T
Paweł Banaszewski 6ea9c61da0 chore: update AI Gateway docs (#24805)
> AI tools where used when creating this PR


This PR:
* removes references to aibridge repository from coder docs
* updates aibdrige/README.md
* makes it clear aibridge (keeping old name) is a handler not a separate
process
* updates outdated sections about: metrics, recorded interface and
supported paths.

---------

Co-authored-by: Susana Ferreira <susana@coder.com>
2026-04-29 18:28:09 +02:00

1.5 KiB

Reference

Implementation Details

coderd runs an in-memory instance of aibridged, whose logic is mostly contained in https://github.com/coder/coder/tree/main/aibridge. In future releases we will support running external instances for higher throughput and complete memory isolation from coderd.

AI Gateway implementation details

Supported APIs

API support is broken down into two categories:

  • Intercepted: requests are intercepted, audited, and augmented - full AI Gateway functionality
  • Passthrough: requests are proxied directly to the upstream, no auditing or augmentation takes place

Where relevant, both streaming and non-streaming requests are supported.

OpenAI

Intercepted

Passthrough

Anthropic

Intercepted

Passthrough

Troubleshooting

To report a bug, file a feature request, or view a list of known issues, please visit our GitHub repository. If you encounter issues with AI Gateway, please reach out to us via Discord.