LLM GatewayInference (OpenAI Compatible)

Text completions

POST
/rest/v1/llm-gateway/v1/completions

Authorization

BearerAuth
AuthorizationBearer <token>

API key passed as Bearer token

In: header

Request Body

application/json

model*string
prompt*string
max_tokens?integer
temperature?number

Response Body

curl -X POST "https://example.com/rest/v1/llm-gateway/v1/completions" \  -H "Content-Type: application/json" \  -d '{    "model": "string",    "prompt": "string"  }'
Empty