Briefs & Updates
Research briefs and AES updates
Two streams: source-linked briefs on evaluation methods and evidence, and updates on AES initiatives, events, and participation.01 · Evaluation Science Briefs
Methods and evidence for agent evaluation
Five-minute, source-linked articles published intermittently.Brief archive
- What’s Wrong With AI Eval “Science”?5 min read
- How Close Is an Agent Evaluation to the Real Workflow?5 min read
- What Does an Agent Evaluation Actually Support?6 min read
- How Do You Know Your Agent Grader Works?6 min read
- Is This Agent Result Reproducible?6 min read
- Is This Agent Good Enough for the Decision?6 min read
- What Should an Agent Evaluation Report So Someone Else Can Use It?6 min read
- Agent Evaluation Requires Methods Beyond Psychometrics7 min read
- Beyond Building the Most Difficult Benchmarks7 min read
Blog
Receive new Evaluation Science Briefs
Subscribe to receive new briefs as we develop the format and grow our editorial team. We welcome submissions of relevant research, evaluation resources, events, and commentary. We also invite researchers and practitioners interested in contributing as writers to contact us.02 · AES Updates & Events
Initiatives, events, and participation
Announcements from AES about research, community programs, events, and ways to participate.AES Updates & Events