llm-d Distributed Inference Meetup NYC

Hosted by Red Hat AI, IBM Research, and AMD, this event takes place on March 11, 2026 in New York City.

What to Expect

Deep technical sessions from llm-d maintainers, committers, and teams using AI at scale
Live demos focused on real distributed workflows
Great networking with food and drinks

*Agenda is subject to change and more awesomeness

4:30pm — Doors Open, Check-In

5:15pm — Intro to llm-d for Open Source Distributed Inference & Project Update

Carlos Costa, Distinguished Engineer, IBM Research

5:35pm — Distributed LLM Serving on AMD with llm-d

Liz Li, Product Application Engineer, AMD
Kenny Roche, Sr. Manager Software Development, ML Framework, AMD

5:55pm — The Path to Intelligent Routing: Lessons Learned Scaling Wide-EP and Mixture-of-Experts (MoE) Models

Nili Guy, R&D Manager, AI Infrastructure - Hybrid Cloud, IBM Research
Tyler Smith, Chief Architect - Inference Engineering, Red Hat AI

6:15pm — KV-Cache Wins You Can See: Prefix-Cache Scheduling, Offloading, and Scaling with llm-d

Maroon Ayoub, Staff Research Scientist, IBM Research

6:35pm — Q&A and Open Discussion

7:00pm — Pizza and Networking 🍕 🤝

8:30pm — Event Ends and Door Close

Registration closes 24 hours before the event. We cannot admit unregistered attendees.

Please bring a photo ID to verify your registration on arrival.

If you are building, deploying, and scaling inference, this is the room to be in. See you soon!