Speakers: Harry Nguyen (insightfactory.ai)
Track: AI Engineering
Your Agents Aren't Failing at Prompting
Every agent demo works. Then you run ten thousand at once, and the failures have nothing to do with the model: dead tuples piling up, a sync HTTP client freezing the event loop, requests hanging forever with no total timeout.
This talk is a look inside how we build and run agents at massive scale in production. It covers what broke, what fixed it, and the lessons that stuck, from why prefetch is really a distributed semaphore, to why layered timeouts beat one big number, to how Postgres as a queue can drive autoscaling at massive scale. It also shows how to get the most out of Postgres and its cache before bringing in Redis.
https://data.webdirections.org/ai-engineer-sydney/sessions.json#f68351a4-f32e-49d0-b672-ac016ea7b866
Full text on webdirections.org
.