Friday, November 20 · Jane Street, New York City

Tentative Program

A one-day program connecting evaluation methods, measures, infrastructure, and real-world evidence.

One-day symposium

Tentative program schedule

9:00–10:00 AM

Arrivals + Breakfast

10:00–10:35 AM

Opening Plenary / KeynoteDiagnosing the state of agent evaluation

10:35–11:45 AM

Session 1Frameworks and measures: What should agent evaluations measure?

11:45–11:55 AM

Coffee

11:55 AM–1:05 PM

Session 2Benchmarks and evaluation infrastructure: Environments, graders, and evaluation systems

1:05–1:55 PM

Lunch + Poster Viewing

1:55–3:05 PM

Session 3Real-world systems: Failures, deployment, and real-world evidence

3:05–3:15 PM

Coffee

3:15–4:00 PM

Fireside ConversationWhat Changes When We Evaluate Agents in the Real World?

4:00–5:55 PM

Poster Session + ReceptionPosters, demos, collaboration, and networking

5:55–6:00 PM

Closing

All times are Eastern Time. The program remains subject to change as speakers and presentations are confirmed.