Papers tagged with: #item-response-theory

8.1
psychometric_modeling

One Percent of the Bank: Adaptive Item Selection Reads Targeted Contamination Up While the Whole Bank Barely Moves

Guan-Yuan Chen, Ya-Fen Yeh · Zenodo (CERN European Organization for Nuclear Research) (2026) · doi:10.5281/zenodo.23156543 · gemini-3.1-flash-lite

Read full analysis →

7.5
psychometric_modeling

Item Response Theory for AI Safety

Joshua Fonseca Rivera, Neil Shah, David Demitri Africa, Konstantinos Voudouris · arXiv (2026) · doi:10.48550/arxiv.2608.05086 · gemini-3.1-flash-lite

Read full analysis →

7.7
psychometric_modeling

Diagnosing the Reliability of LLM-as-a-Judge via Item Response Theory

Junhyuk Choi, Sohhyung Park, Chanhee Cho, Hyeonchu Park, Bugeun Kim · arXiv (2026) · doi:10.48550/arxiv.2602.00521 · gemini-3.7-flash

Read full analysis →

7.5
psychometric_modeling

Every Wrong Answer Counts: Option-Level Psychometrics for LLM Multiple-Choice Benchmarks

Xiao Fei, Yang Zhang, Sarah Almeida Carneiro, Michalis Vazirgiannis · arXiv (2026) · doi:10.48550/arxiv.2608.02966 · gemini-3.1-flash-lite

Read full analysis →

7.5
psychometric_modeling

An Interpretable and Scalable Framework for Evaluating Large Language Models

Xinhao Qu, Qiang Heng, Hao Zeng, Xiaoqian Liu · arXiv (2026) · doi:10.48550/arxiv.2605.07046 · gemini-3.7-flash

Read full analysis →

7.5
psychometric_modeling

Are Near-Tied LLM Rankings Robust to Family-DIF-Guided Benchmark Recomposition?

Qiaoyuan Zheng, Yiqu Yang · arXiv (2026) · doi:10.48550/arxiv.2609.00482 · gemini-3.1-flash-lite

Read full analysis →

7.3
psychometric_modeling

Auditing LLM Benchmarks with Item Response Theory

Sander Land, Daniel M. Bikel · arXiv (2026) · doi:10.48550/arxiv.2605.30504 · gemini-3.6-flash

Read full analysis →

7.3
psychometric_modeling

Algorithmic drift in generative adaptive learning

Firuz Kamalov, Hana Sulieman, Ahmed El Sayed, Sivaraj R., Nitesh Sughnani · arXiv (2026) · doi:10.48550/arxiv.2610.31041 · gemini-3.7-flash

Read full analysis →

7.2
psychometric_modeling

Extending Item Response Theory for Efficient and Meaningful Multilingual Evaluation

Gili Lior, Tzviel Frostig, Gabriel Stanovsky, Matan Eyal · arXiv (2026) · doi:10.48550/arxiv.2606.15643 · gemini-3.7-flash

Read full analysis →