API Throughput Limit
Compare a request-rate quota with concurrency and service time.
Your numbers
Steady-state throughput ceiling
Steady-state upper bound, not a scheduler. Burst windows, retries, token quotas, queue delays and provider-specific enforcement are excluded.
Scenario comparison
Up to three snapshots in this tab. Loading one replaces the current inputs.
Formula
Use q ≤ min(R/60,c/s) and t ≈ N/q. R is requests allowed per minute, c is concurrent slots, s is average service seconds, N is batch requests, q is requests per second, and t is ideal batch seconds.
Compare a request-rate quota with concurrency and service time.
Worked example
- Requests allowed per minute
- 600
- Concurrent request slots
- 5
- Average service time (seconds)
- 1
- Requests to process
- 1000
- Steady-state throughput ceiling
- 5 requests/s
- Ideal steady-flow batch duration
- 200 seconds
- Concurrency-limited throughput
- 5 requests/s
Scope and limitations
Steady-state upper bound, not a scheduler. Burst windows, retries, token quotas, queue delays and provider-specific enforcement are excluded.
Inputs are checked for missing values and allowed ranges. A result outside the finite numeric range is not displayed. Rounding affects display, while the calculation uses the model’s numeric precision.
Check your units and assumptions before relying on a result. Changing a label does not convert a currency or physical unit.
Formula version: f349607ebf43 · Example checked: