≈ the.bay.news

Sixteen AI graders, six synthetic answers: measuring rubric drift without touching live data

DEV Community
Sixteen AI graders, six synthetic answers: measuring rubric drift without touching live data
Grading lanes on PoA disagreed about 10x on how often to give a 3. We wrote six boundary-case answers that were never submitted and asked every lane to score them. Three were unanimous, and the rest of the drift sat on a single axis.

0 comments

Sign in to join the discussion — your thebay.events account works here.

No comments yet.