Skippy The Little Inference Engine That CUDA

Name: Skippy: The Little Inference Engine That CUDA
Start: 2026-12-06T13:00:00.000Z
End: 2026-12-07T13:00:00.000Z
Location: Research / Deep Tech room

Where: Research / Deep Tech room 488 George Street, 2000, Sydney
Host: Web Directions
Entry: Not stated
Sign-up: On the host's page

Open on webdirections.org

All Sydney events

You sign up with the host. foundercal only links to it.

Your event? Manage this listing Report a change

Who you meetThe people on the listing, and what the host tells us about the room.

James Dumay Speaker
Daniel Winter-Wijntjes Speaker

Investors Not stated The listing does not say

The format Talks, then talking Meetup

Sign-up On the host's page Price not stated

AboutIn the host's words.

Speakers: James Dumay (Stealth AI Startup), Daniel Winter-Wijntjes (Stealth AI Startup)

Track: Research / Deep Tech

What happens under the hood when you run a large language model? This talk explores Skippy, a custom inference engine built for Mesh on top of llama.cpp, and the engineering behind local and distributed AI inference.

We'll start with a practical primer on how inference works, then look at splitting large models across multiple computers, reusing work through KV caching, and accelerating generation with speculative decoding. Drawing on the experience of building Skippy as a standalone engine, we'll unpack the nuts and bolts, trade-offs and lessons involved in making large models run on the hardware you have.

https://data.webdirections.org/ai-engineer-sydney/sessions.json#cd291bf8-0104-4500-84f1-bc9c6cf68148

Full text on webdirections.org .