psychometric_modeling
Laplace-PSN-IRT: Uncertainty Quantification for Neural Item Response Theory Models of LLM Benchmarks
Juan Francisco, Mandujano Reyes · arXiv (2026) · doi:10.48550/arxiv.2607.25257 · gemini-3.1-flash-lite
Papers tagged with: #irt
psychometric_modeling
Latent Impact and Differential Item Functioning Analysis for Asymmetric IRT Models
Gabriel Wallin, Qi Huang · arXiv (2026) · doi:10.48550/arxiv.2605.05684 · gemini-3.1-flash-lite
psychometric_modeling
Every Wrong Answer Counts: Option-Level Psychometrics for LLM Multiple-Choice Benchmarks
Xiao Fei, Yang Zhang, Sarah Almeida Carneiro, Michalis Vazirgiannis · arXiv (2026) · doi:10.48550/arxiv.2608.02966 · gemini-3.1-flash-lite
psychometric_modeling
An Interpretable and Scalable Framework for Evaluating Large Language Models
Xinhao Qu, Qiang Heng, Hao Zeng, Xiaoqian Liu · arXiv (2026) · doi:10.48550/arxiv.2605.07046 · gemini-3.7-flash
psychometric_modeling
Detection of two-way outliers in multivariate data and application to cheating detection in educational tests
Yunxiao Chen, Yan Lu, Irini Moustaki · The Annals of Applied Statistics (2022) · doi:10.1214/21-aoas1564 · gemini-3.1-flash-lite
psychometric_modeling
What Makes Something Hard(er)? Explaining Question Difficulty in Natural Language
Peng Cui, Qiaoyuan Zheng, Rudolf Debelak, Mrinmaya Sachan · arXiv (2026) · doi:10.48550/arxiv.2610.01627 · gemini-3.1-flash-lite
psychometric_modeling
Auditing LLM Benchmarks with Item Response Theory
Sander Land, Daniel M. Bikel · arXiv (2026) · doi:10.48550/arxiv.2605.30504 · gemini-3.6-flash
psychometric_modeling
A regularised latent‐class item response model for detecting measurement non‐invariance in ordinal response scales
Gabriel Wallin, Qi Huang · British Journal of Mathematical and Statistical Psychology (2026) · doi:10.1111/bmsp.70076 · gemini-3.1-flash-lite
psychometric_modeling
CalibratedRubric: Task-Adaptive Rubric Banks for Open-Ended LLM Evaluation
Mengting Chen, Yanshu Sun, Wanting Liang, Beidi Luan, Rui Sun, Dezhi Chen, Jing Li, Zuo Bai · arXiv (2026) · doi:10.48550/arxiv.2607.29252 · gemini-3.1-flash-lite