detector_evaluation
StyleShield: Exposing the Fragility of AIGC Detectors through Continuous Controllable Style Transfer
Guantian Zheng · arXiv (2026) · doi:10.48550/arxiv.2605.00924 · gemini-3.1-flash-lite
Papers tagged with: #assessment-validity
theoretical
Correct codes for the wrong reasons? validating LLMs as measurement instruments for theoretical constructs
Manuel Pita · arXiv (2026) · doi:10.48550/arxiv.2606.28574 · gemini-3.1-flash-lite
psychometric_modeling
Every Wrong Answer Counts: Option-Level Psychometrics for LLM Multiple-Choice Benchmarks
Xiao Fei, Yang Zhang, Sarah Almeida Carneiro, Michalis Vazirgiannis · arXiv (2026) · doi:10.48550/arxiv.2608.02966 · gemini-3.1-flash-lite
psychometric_modeling
Evaluating LLM-as-a-Judge Beyond Score Alignment: A Psychometric Analysis of Residual Judging Difficulty
Longwei Cong, Sonja Hahn, Sebastian Gombert, Leon Camus, Fabian Zehner, Hendrik Drachsler, Ulf Kroehne · arXiv (2026) · doi:10.48550/arxiv.2610.02877 · gemini-3.1-flash-lite
psychometric_modeling
Are Near-Tied LLM Rankings Robust to Family-DIF-Guided Benchmark Recomposition?
Qiaoyuan Zheng, Yiqu Yang · arXiv (2026) · doi:10.48550/arxiv.2609.00482 · gemini-3.1-flash-lite
psychometric_modeling
What exam scores can and cannot prove about unauthorized AI assistance: Evidence from a highly public classroom episode
Chad M. Topaz, Utsav Bahl · arXiv (2026) · doi:10.48550/arxiv.2607.27978 · gemini-3.1-flash-lite
psychometric_modeling
Representational Control over Self-Report & Behavior Coherence in LLM Risk-Taking
Rafal Kocielnik, Peiyang Song, Pengrui Han, Myrl G. Marmarelis, Ramit Debnath, Dean Mobbs, R. Michael Alvarez · arXiv (2026) · doi:10.48550/arxiv.2610.04125 · gemini-3.1-flash-lite
psychometric_modeling
Identifying Causes of Test Unfairness: Manipulability and Separability
Youmi Suk, Weicong Lyu · arXiv (2026) · doi:10.48550/arxiv.2601.13449 · gemini-3.1-flash-lite
psychometric_modeling
Auditing LLM Benchmarks with Item Response Theory
Sander Land, Daniel M. Bikel · arXiv (2026) · doi:10.48550/arxiv.2605.30504 · gemini-3.6-flash
detector_evaluation
Why AI Detection Fails for Academic Integrity
Jonathan A. Karr, Grigorii Khvatskii, Ting Hua, Nitesh V. Chawla · arXiv (2026) · doi:10.48550/arxiv.2608.11256 · gemini-3.1-flash-lite
assessment_design
Automated Refinement of Essay Scoring Rubrics for Language Models via Reflect-and-Revise
Keno Harada, Lui Yoshida, Takeshi Kojima, Yusuke Iwasawa, Yutaka Matsuo · Conference on Computational Natural Language Learning (2026) · doi:10.18653/v1/2026.conll-main.47 · gemini-3.6-flash
psychometric_modeling
Reducing Differential Item Functioning via Process Data
Ling Chen, Susu Zhang, Jingchen Liu · arXiv (2025) · doi:10.48550/arxiv.2504.00136 · gemini-3.1-flash-lite