Route calls through the gateway
Add a provider credential, register a model, test it in the Playground, and call the OpenAI-compatible gateway from curl, the SDK, or the OpenAI client.
Chat, stream, and collect feedback with the SDK
Call the gateway from the SDK with chat() and streaming, run a traced tool-calling loop, then read traces back and record feedback — in Node and Python.
Scope access with virtual keys
Create a gateway key restricted to one model, a rate cap, and a cache TTL, so a leaked key can't spend outside its job.
Set spend limits
Cap spend team-wide or per key by day, week, month, or total, and pair it with a request-rate cap — then prove both actually reject a call before it costs anything.
Retries and fallbacks
Three separate things retry a failing LLM call, and each is set in a different place. Configure all three, then read two real traces to see which one fired.