Authentication
Execute a chat completion
oximy/auto for the project’s active routing policy or a
provider-prefixed model ID for an explicit model.
The response uses an OpenAI-compatible chat-completion envelope. Relay can also
return:
For streaming, send
"stream": true. Relay returns server-sent events when
the selected provider and request path support streaming. Include
"stream_options": {"include_usage": true} when usage in the stream is needed.
Request a routing decision
UsePOST /v1/route when Relay should choose the model but your infrastructure
should execute the provider request.
model and decision_id. Preserve the decision
identifier in execution telemetry so Relay can correlate the recommendation
with the outcome.
Send OpenTelemetry traces
Send OTLP/HTTP protobuf traces to:Handle failures
Preserve the HTTP status, sanitized error body, request or decision identifier,
and UTC timestamp when investigating a failure.
Gateway behavior
Understand automatic and explicit model execution through Relay.
Route-only behavior
Keep provider execution, retries, credentials, and fallback in your
infrastructure.