2 Commits

Author	SHA1	Message	Date
Sas Swart	b9d237b42c	perf: improve memory use and cpu usage for OpenAI requests handled by bridge (#21838) ... Apply optimizations: * https://github.com/openai/openai-go/pull/602 * https://github.com/coder/aibridge/pull/160 These reduce CPU time and allocation count for OpenAI `chat/completions` and `responses` APIs, making the use of OpenAI chat models through AI Bridge more performant. In order to test these changes, we add scaletesting support for the responses API.	2026-02-02 16:16:16 +02:00
Sas Swart	0ebe8e57ad	chore: add scaletesting tools for aibridge (#21279) ... This pull request adds scaletesting tools for aibridge. See https://www.notion.so/Scale-tests-2c5d579be5928088b565d15dd8bdea41?source=copy_link for information and instructions. closes: https://github.com/coder/internal/issues/1156 closes: https://github.com/coder/internal/issues/1155 closes: https://github.com/coder/internal/issues/1158	2026-01-15 17:05:46 +02:00