psychometric_modeling
Diagnosing the Reliability of LLM-as-a-Judge via Item Response Theory
Junhyuk Choi, Sohhyung Park, Chanhee Cho, Hyeonchu Park, Bugeun Kim · arXiv (2026) · doi:10.48550/arxiv.2602.00521 · gemini-3.7-flash
Papers tagged with: #automated-scoring
psychometric_modeling
From Scoring to Explanations: Evaluating SHAP and LLM Rationales for Rubric-based Teaching Quality Assessment
Ivo Bueno, Babette Bühler, Philipp Stark, Tim Fütterer, Ulrich Trautwein, Dorottya Demszky, Heather Hill, Enkelejda Kasneci · arXiv (2026) · doi:10.48550/arxiv.2606.05180 · gemini-3.6-flash
assessment_design
Towards Scalable Measurement of Durable Skills
Amir Globerson, Amy Keeling, Anisha Choudhury, Anna Iurchenko, Aviad Segal, Avinatan Hassidim, Ayça Çakmakli, Ben Gomes, Benn Witt, Cathy Cheunga, Cristine Legare, Diana Akrong, Eliad Carmi, Elisabeth Bauer, Gal Elidan, Hadas Gelbart, Hairong Mu, Katherine Chou, Lev Borovoi, Nir Kerem, Niv Efron, Noa Kerrem Gilo, Preeti Singh, Rajvi Kapadia, Rena Levitt, Roni Rabin, Ronit Levavi Morad, Rotem Yulzary, Shashank Agarwal, Sophie Allweis, Tracey Lee-Joe, Tzvika Stein, Yael Bar Moshe, Yael Haramaty, Yaniv Carmel, Yishay Mor, Yoav Bar Sinai, Yoav Bergner, Yossi Matias, Yuri Lev · arXiv (2026) · doi:10.48550/arxiv.2609.15864 · gemini-3.1-flash-lite
assessment_design
MisconceptDialogue: Evaluation Criteria Shape Measured Success in LLM Math Tutoring
Woojin Lee, Yoonkyu Woo, Jinah Kim, Hyeok-Min Gwon, Jin‐Xia Huang · arXiv (Cornell University) (2026) · doi:10.48550/arxiv.2610.31679 · gemini-3.6-flash
psychometric_modeling
Operating characteristics of agreement metrics in AI-based scoring: a Monte Carlo simulation
Alperen Yandi · Frontiers in Psychology (2026) · doi:10.3389/fpsyg.2026.1705653 · gemini-3.8-flash
psychometric_modeling
The Impact of LLM Self-Consistency and Reasoning Effort on Automated Scoring Accuracy and Cost
Scott Frohn · arXiv (2026) · doi:10.48550/arxiv.2604.26954 · gemini-3.7-flash