Built a visual debugging panel for agent-design over the weekend
Some background first. Our setup is agent-design plus three downstream services, seven figures of daily requests, peaking around nine in the evening.
What genuinely surprised me was the tail. The average looked great while P99 jumped by an order of magnitude past some threshold. The cause was not agent-design itself but our upstream connection reuse — the load test traffic was too clean and hid the long-tail requests.
POST /api/uploads → CDN origin pull