LLM GatewayInference (Anthropic Native)

Create message (Anthropic Messages API)

POST
/rest/v1/llm-gateway/v1/messages

Native Anthropic Messages API. Supports streaming via stream=true.

Authorization

BearerAuth
AuthorizationBearer <token>

API key passed as Bearer token

In: header

Request Body

application/json

model*string
messages*array<>
max_tokens*integer
temperature?number
stream?boolean
system?string

Response Body

application/json

curl -X POST "https://example.com/rest/v1/llm-gateway/v1/messages" \  -H "Content-Type: application/json" \  -d '{    "model": "claude-sonnet-4-20250514",    "max_tokens": 1024,    "messages": [      {        "role": "user",        "content": "Explain quantum computing in one paragraph."      }    ],    "temperature": 0.7  }'
{  "id": "msg_abc123",  "type": "message",  "role": "assistant",  "content": [    {      "type": "text",      "text": "Quantum computing leverages quantum mechanical phenomena..."    }  ],  "model": "claude-sonnet-4-20250514",  "stop_reason": "end_turn",  "usage": {    "input_tokens": 15,    "output_tokens": 82  }}