Sixteen AI graders, six synthetic answers: measuring rubric drift without touching live data
DEV Community
Sixteen AI graders, six synthetic answers: measuring rubric drift without touching live data
Grading lanes on PoA disagreed about 10x on how often to give a 3. We wrote six boundary-case answers that were never submitted and asked every lane to score them. Three were unanimous, and the rest of the drift sat on a single axis.
0 comments
No comments yet.