LLM Gateway Usage and Billing
How many gateways you can have
LLM gateways are included with selected CDN plans. The LLM Gateway page shows how many you have used and how many your plan allows. To get more, buy extra gateways from Resource Add-ons, or move to a plan that includes more.
What you pay for traffic
Traffic through your gateway counts as ordinary CDN bandwidth on your plan, in both directions. There are no per-token or per-request fees from CDNShark. The model runs on your own hardware, so we don't charge for it.
Usage on the gateway page
The gateway page shows the last 7 days: requests, client errors, server errors, data sent to your model and data received back. These numbers:
- Are about a minute behind.
- Don't include requests without a valid key.
- Are for your information. Billing uses your CDN bandwidth, not these numbers.
Rate limits
Your plan may set a limit on requests per minute for each key. Over the limit, the gateway answers 429 with a Retry-After header telling your app how long to wait.