Limit AI Service Query Volume and Rate
Limit the number and rate of requests that users can submit to an AI service. Apply limits by user, API key, tenant, device, or other authenticated identity. Use short-term rate, burst, and concurrency limits together with longer-term usage quotas. Query limits can increase the time and cost required to extract model information, optimize adversarial inputs, discover system behavior, verify attacks, or overwhelm a service. Monitor for attempts to evade limits through distributed requests, account rotation, or stolen credentials. Query limits may not protect against attacks that require few requests or are performed against an offline model.
Confidence
Limit the number and rate of requests that users can submit to an AI service. Apply limits by user, API key, tenant, device, or other authenticated identity. Use short-term rate, burst, and concurrency limits together with longer-term usage quotas. Query limits can increase the time and cost required to extract model information, optimize adversarial inputs, discover system behavior, verify attacks, or overwhelm a service. Monitor for attempts to evade limits through distributed requests, account rotation, or stolen credentials. Query limits may not protect against attacks that require few requests or are performed against an offline model.