From vibes to a systematic eval flywheel evals for high stakes AI agents

Name: From vibes to a systematic eval flywheel: evals for high stakes AI agents
Start: 2026-12-06T13:00:00.000Z
End: 2026-12-07T13:00:00.000Z
Location: AI Engineering room

Where: AI Engineering room 488 George Street, 2000, Sydney
Host: Web Directions
Entry: Not stated
Sign-up: On the host's page

Open on webdirections.org

All Sydney events

You sign up with the host. foundercal only links to it.

Who you meetThe people on the listing, and what the host tells us about the room.

Donna Zhou Speaker
Rok Stular Speaker

Investors Not stated The listing does not say

The format Talks and halls Conference

Sign-up On the host's page Price not stated

AboutIn the host's words.

Speakers: Donna Zhou (Lorikeet), Rok Stular (Lorikeet)

Track: AI Engineering

If you are sceptical about how evals drive real results, or looking for more depth than introductory tutorial videos, this talk is for you.

We'll show you how Lorikeet, an AI customer service startup, built an eval system to rapidly raise the quality of a complex AI agent. Coach is our AI assistant that helps customers configure their AI concierges that automate millions of tickets every month, with a huge surface area of use cases. We'll share our journey from receiving vague vibes-based feedback about low quality answers, to how we systematically built a flywheel to rapidly improve the quality.

https://data.webdirections.org/ai-engineer-sydney/sessions.json#363ab615-2804-40a1-859c-5f9bbe26649b

Full text on webdirections.org .