
Designing Benchmarks for Knowledge Work
A framework for designing and reporting benchmarks of knowledge work. Besides its tasks, environment, and metric, a benchmark should state four fields: the work it represents, the setting it tests, the work product the task requires, and the part of that product it scores. The paper derives each field from research on how knowledge work is organized and applies the framework to GDPval, OfficeQA Pro, and APEX-SWE.