Follow us Education
Learn agent evaluation science by doing it
EvalScience is starting two programs: mentored projects and open courses. Neither is fully established yet. We are collecting interest and applying for funding now, and we would welcome help along the way.
Mentored research
Mentored projects
Small teams work with an experienced mentor and compute support on a question from our Research Agenda. Results are published on Research & Commons.
- Safety evaluation
- RL environments
- Graders and verdicts
- Evaluations that predict real outcomes
- Benchmark design
- Statistics and reporting
- People working with agents
- Agents after deployment
- Length
- 12 weeks
- Format
- Remote
- Time
- About 10 hours a week
- Team
- 2–3 mentees per mentor
Call for Course Design
Open courses
We are building an open curriculum on agent evaluation one subsection at a time, taught by people across the EvalScience network. A subsection can be a single lecture, a hands-on lab, a short series or a reading guide.
A subsection can follow a direction in our Research Agenda, or propose a way to refine the agenda itself.
A subsection appears on this page once it has a committed instructor and an outline.
We will not reach out to everyone individually. To hear about future events and updates, subscribe to our calendar. Want to help set up the programs? Write to contact@evalscience.org.