3 articles tagged P99Latency
Queueing theory for backend capacity
Why doubling traffic can quadruple tail latency, how to model each constrained resource as a queue, and how to measure utilisation before you hit the cliff.
14 min read · 8 November 2026
AI errors hide in plain latency
Why token counts and GPU utilization miss user-visible AI degradation, and how to instrument end-to-end p95/p99 latency and error rate instead.
10 min read · 21 August 2026
Tool calling: stateless beats stateful under load
How request-scoped and pooled tool calls behave under load, what to instrument, and a decision checklist for choosing between them.
11 min read · 19 June 2026