Oops I Hacked It Again: Six Months of Red Teaming Our AI Agents
Picture: Web Directions

Conference In 6 weeks

December
Monday
to Tue 8 December 2026 · Sydney time

Oops I Hacked It Again Six Months of Red Teaming Our AI Agents

Where
AI Engineering room 488 George Street, 2000, Sydney
Host
Web Directions
Entry
Not stated
Sign-up
On the host's page
Open on webdirections.org

All Sydney events

You sign up with the host. foundercal only links to it.

Who you meetThe people on the listing, and what the host tells us about the room.

  • Jon Shen Speaker
Investors Not stated The listing does not say
The format Talks and halls Conference
Sign-up On the host's page Price not stated

AboutIn the host's words.

Speakers: Jon Shen (Suncorp)

Track: AI Engineering

In March I onboarded our first team member dedicated to AI Red Teaming. That was a month before the announcement of Claude Mythos Preview, and the open letters that followed from APRA in April and ASIC in May (Australia’s prudential and conduct regulators) warning organisations to act by shoring up their AI risk management and security practices. We moved before these events because we could see the impending and growing risks, and that specialised skills are needed to keep our customers safe.

Six months and eight deployments later we have broken in repeatedly. We have great data scientists and AI engineers, but the reality is that the skills and mindset needed to build robust AI systems are different from what's necessary to defend them. The surprising thing was the multitude of failure modes we observed, across prompts and architecture, demonstrating the many gaps developers must intentionally think about.

This talk covers what we tested and how, including the process failures we didn't expect, and what we've built to prepare for the future. Leaders will leave with practical steps to start building their own AI red team and defending their AI systems.

https://data.webdirections.org/ai-engineer-sydney/sessions.json#a5764637-5374-4a78-933d-db1a88c06255

Full text on webdirections.org .

Where

AI Engineering room

488 George Street, 2000, Sydney

Open in Maps ↗

Same week in Sydney All 139 events

Dec
to 5 Dec
Hackathon

AI Engineer Hackathon

Founders pitch

Web Directions Free
Dec
to 13 Dec
Conference

AI Week

Web Directions
Dec
to 12 Dec
Conference

NeurIPS 2026

One of the year's big ones

NeurIPS Foundation
Dec
to 8 Dec
Meetup

Lessons from Economics for the Human / Agent Software Workforce

Leadership room
Web Directions
Dec
to 8 Dec
Meetup

Ontologies

AI Engineering room
Web Directions
Dec
to 8 Dec
Meetup

Shipping together in an AI native team

Software Engineering room
Web Directions
Dec
to 8 Dec
Meetup

Dependency hell is back. This time it's your agent's config.

Software Engineering room
Web Directions
Dec
to 8 Dec
Meetup

Your website is a terrible API

AI Engineering room
Web Directions
Dec
to 8 Dec
Meetup

Sovereignty Is an Inference Problem

Leadership room
Web Directions
Dec
to 8 Dec
Meetup

My Agents broke APIs

AI Engineering room
Web Directions
Open on webdirections.org Mon 7 Dec ↗