HACKATHON - Agent Eval Harness
Picture: The Friendly Data Meetup London

Hackathon In 6 days

November
Wednesday
17:30–21:00 2026 · London time

HACKATHON Agent Eval Harness

Where
230 Blackfriars Rd London SE1 8NW, UK
Host
The Friendly Data Meetup London
Entry
Free
Sign-up
Apply, the host picks
Apply on Luma

All London events

You sign up with the host. foundercal only links to it.

Who you meetThe people on the listing, and what the host tells us about the room.

  • DL Lim Host
Investors Not stated The listing does not say
The format Teams build Hackathon
Sign-up Apply, the host picks Free

AboutIn the host's words.

Hi new friends and old! The Friendly Data Meetup Hackathon is back by popular demand! 🎉

After the brilliant turnout (and the even more brilliant demos) at our first hackathon in January, we simply had to do it again.

👩‍💻 This evening is all about learning, building, and having fun with friendly faces. No pressure, no pitch decks, just inquisitive minds making cool things with data. With perhaps a slight competitive edge for those seeking glory 😉

📍 We're very grateful to Quantspark for kindly hosting us at their venue for the evening!

💡 The challenge: Judge the Agent ⚖️

Dawdle Deliveries' shiny new AI customer support bot goes live next week. Is it actually ready? Your job is to find out, with evidence instead of vibes!

AI agents are moving into production, and everyone is asking the same question: how do you know it works? Together, we'll find out by building an evaluation harness from scratch:

  • 🧪 Write the tests: a set of realistic (and sneaky) customer questions

  • ✅ Build the checks: automatic pass/fail checks, plus an AI judge that marks every answer

  • 🔧 Fix it and prove it: improve the bot, then show a before/after scorecard proving your fix worked (without breaking anything else!)

The challenge is split into levels, so every team can work at its own pace, and there are bonus rounds (tracing, red-teaming, model shoot-outs) for the speedy ones. We'll finish with quick 3-minute demos: your scorecard, your most interesting failure, and the big question: do you trust your judge? 🤔

You’re welcome to choose your own team of 2-4, or teams will be formed on the evening, so don’t worry if you’re coming solo.

✅ Pre-flight checklist

This hackathon is very hands-on, so it's best suited to people who already write code and/or have some working knowledge with data and AI. You'll get the most out of the evening if you:

  • Have decent working experience writing code

  • Are very comfortable with git, Docker and Python environments

  • Are happy to dig in and figure things out with your team (organisers will be around to help, but there won't be step-by-step hand-holding)

🎒 Please bring

  • A laptop (charged!) and charger; preinstalled with:- Docker

  • uv

  • An LLM of your choice to work with, either:- your own API key for a hosted provider of your choice, or

  • free local models running via Ollama in Docker (no key needed, but allow around 10 GB of free disk space)

  • Curiosity and a willingness to collaborate

🌄 On that evening

When you arrive at the venue, show your Luma QR code, and say you're going to Quantspark for the Hackathon.

17:30 - Doors open

18:00 - Hackathon begins

21:00 - Hackathon ends, and building management cut off time

21:01 - Nearby pub!

📶 Wi-Fi will be provided at the venue.

We'll share the starter kit with registered participants before the event, so please download everything (especially the local models) in advance. They're a few GB, and the Wi-Fi is no match for a whole room pulling them at once! 😅

📒IMPORTANT NOTE

To take part in the hackathon, please sign up on Luma here. You will be required to show your QR code at the reception. RSVP on Meetup does not count as registration for this event, so sign up on Luma now to secure your place!

Spaces are limited, so please let us know if you can't make it, so that we may free your seat up for someone else :)

Many thanks for your enthusiasm and participation! We can't wait to build with you 😄

If you like this event, check out our first ever fireside chat happening in November too:

Full text on Luma .

Where

230 Blackfriars Rd

London SE1 8NW, UK

Open in Maps ↗

Same week in London All 170 events

Oct
Thu 09:00
Hackathon

Hack for Humanity

Corgi Cafe
The AI Collective
Free
Oct
Thu 17:30
Meetup

Founders & AI

The Brew Eagle House – Coworking Space & Office Space
Anurag Jain
Free
Oct
Thu 18:00
Meetup

The Funeral of Good Ideas

Investors in the room

Sclr labs
Oct
Thu 18:00
Dinner

London Community Dinner

Padella Soho
The Community Collective
Free
Oct
Thu 18:00
Meetup

The Inner Game of Being a Founder

Imperial College London
Imperial Entrepreneurs
Free
Oct
Thu 18:00
Workshop

Build with OpenAI Codex

Agent Builders
Oct
Thu 18:30
Meetup

Is AI making us less creative?

Granola
The Founder-writer Collective
Free
Oct
Thu 18:30
Meetup

Demos Anon #7

Investors in the room

Pillar VC
Lynetta Wang
Free
Oct
Thu 19:00
Meetup

London Startup Halloween Party

Encode Hub
Encode Club
£6
Oct
Fri 09:15
Meetup

The Friday WFH Club

Portobello Road
Build with AI: Workshops & Coworking
Apply on Luma Wed 4 Nov ↗