psychometric_modeling
Agreement Metrics for LLM-as-Judge Evaluation: What to Report and Why
Delip Rao, Chris Callison-Burch · arXiv (2026) · doi:10.48550/arxiv.2606.00093 · gemini-3.8-flash
Статті за тегом: #inter-rater-reliability
assessment_design
MisconceptDialogue: Evaluation Criteria Shape Measured Success in LLM Math Tutoring
Woojin Lee, Yoonkyu Woo, Jinah Kim, Hyeok-Min Gwon, Jin‐Xia Huang · arXiv (Cornell University) (2026) · doi:10.48550/arxiv.2610.31679 · gemini-3.6-flash
psychometric_modeling
Operating characteristics of agreement metrics in AI-based scoring: a Monte Carlo simulation
Alperen Yandi · Frontiers in Psychology (2026) · doi:10.3389/fpsyg.2026.1705653 · gemini-3.8-flash