LLM GatewayInference (OpenAI Compatible)

Count tokens (OpenAI format)

POST
/rest/v1/llm-gateway/v1/count_tokens

Authorization

BearerAuth
AuthorizationBearer <token>

API key passed as Bearer token

In: header

Request Body

application/json

Response Body

curl -X POST "https://example.com/rest/v1/llm-gateway/v1/count_tokens" \  -H "Content-Type: application/json" \  -d '{}'
Empty