Papers tagged with: #rater-drift

7.5
psychometric_modeling

From Feature-Based Models to Generative AI: Validity Evidence for Constructed Response Scoring

Jodi M. Casabianca, Daniel F. McCaffrey, Matthew S. Johnson, Naim Alper, Vladimir Zubenko · arXiv (2026) · doi:10.48550/arxiv.2603.19280 · gemini-3.8-flash

Read full analysis →

7.4
psychometric_modeling

Machine--human agreement in marking undergraduate assignments is specific to model, prompt and institution

Giulio Corsi, Maryam Abo-Tabik, Yael Benn, Georgiana Thorpe Apreutesei, Roni Tibon, Alexandru Marcoci, Deborah Talmi · arXiv (2026) · doi:10.48550/arxiv.2610.18019 · gemini-3.8-flash

Read full analysis →

7.8
assessment_design

Rubrics Carry the Standard: Shapley Attribution for Checklist-Based LLM Judges

Saeid Asgari, Rui Ying, Sara Malvar, Rakshanda Agarwal, Bruce Sun, Claire Wang, Leonardo de Oliveira Nunes, Ranveer Chandra · arXiv (2026) · doi:10.48550/arxiv.2610.24971 · gemini-3.8-flash

Read full analysis →