Skip to main content
All inference endpoints live under /inf/v1 and accept a workspace inference key through Authorization: Bearer or x-api-key. Use the same key with the normal API-key argument of the OpenAI or Anthropic SDK.
Credentials are selected in order: a non-empty bearer token, a non-empty x-api-key, then the playground cookie. Authorization headers using another scheme and empty header values are skipped. The selected key is authenticated once; an invalid key returns 401 invalid_token without trying lower-priority credentials. Cookie authentication requires X-Requested-With; when Sec-Fetch-Site is present, only same-origin and none are accepted.

​
Surfaces

Discover models with GET /inf/v1/models and retrieve one with GET /inf/v1/models/{model_id} using the same inference key. These routes return the OpenAI Models shape. See model discovery for details. The generated OpenAPI spec covers the management API. Inference endpoints and their shared behavior are described in these reference pages. The caller surface does not constrain the provider route. A Messages request can target an OpenAI-compatible model; a Chat Completions request can target an Anthropic model. airmux returns the response and errors in the caller’s dialect. Each path binds exactly one caller protocol; headers and body fields cannot change it.

​
Shared behavior

Every surface uses the same:
  • Model catalog and capability checks
  • Inference-key authentication
  • Workspace policy evaluation
  • Provider-credential selection
  • Fallback planning
  • Parameter reconciliation and visible adjustments
  • Usage and cost accounting

​
Response headers

The data plane applies these headers to every HTTP response, including health checks, authentication failures, and unexpected server errors. Health and readiness checks remain public. X-Request-ID matches the request ID in usage events when an event is recorded. Provider completion IDs in response bodies retain their own meaning. Caller-supplied request IDs do not replace the gateway ID. The response renderer owns Content-Type; middleware forwards streaming bytes without buffering. Existing Retry-After headers are preserved. The 401 challenge advertises bearer authentication. realm="airmux" labels the authentication scope and does not change key validation. The packaged Nginx proxy preserves the SSE cache directive and disables inference buffering. Nginx consumes X-Accel-Buffering, so that header may be absent at the public edge.

​
Model selection

Managed catalog model IDs use provider/model form. List the models visible to your inference key:
The model must support every required input modality and capability. Streaming, tools, reasoning, and structured output are inferred from the request rather than trusted as caller metadata. The management command airmux models list -f json lists the organization catalog with a management key; it does not apply inference-key policies.

​
Base URLs

If the public airmux origin is https://llm.example.com:

​
Limits

The checked-in Nginx proxy accepts request bodies up to 32 MB and allows an established inference response to remain idle for up to 300 seconds. Provider clients and other ingress proxies may have smaller limits. Fallback deadlines apply only until response headers arrive; they do not cap an established stream. See errors for stable gateway codes and models and providers for catalog fields.