assessment_design
A Judge Should Know What Changed:Construct Validity for LLM-as-a-Judge Evaluation
Jianlin Chen, Wenhui Chen, Ziyao Lin, Chi Man Vong · arXiv (2026) · doi:10.48550/arxiv.2608.24419 · gemini-3.1-flash-lite
Статті за тегом: #дизайн-оцінювання
assessment_design
GAUGE: When Not to Trust LLM-as-a-Judge in User-Simulated Evaluation of Task-Oriented Agents
Umesh Bodhwani, Thanh Tran, Kai Wei · arXiv (2026) · doi:10.48550/arxiv.2609.12191 · gemini-3.1-flash-lite
quasi_experiment
Pressure, Context, and Machine Self-Control: A Criminological Test of Reward Hacking in Generative AI Models
Murat Ozer, Isaac Kofi Nti · arXiv (2026) · doi:10.48550/arxiv.2610.04793 · gemini-3.1-flash-lite
assessment_design
Fighting Fire with Fire: On the Feasibility of Protecting Exercises Against AI Cheating
Tobias Braun, Jonas Grebe, Louis Rethfeld, Marcus Rohrbach · arXiv (2026) · doi:10.48550/arxiv.2608.01112 · gemini-3.1-flash-lite
psychometric_modeling
Check The Scoreboard: An Analysis of Scoring Schemes on Multiple-Choice Evaluation
Nishant Balepur, Paiheng Xu, Wei Ai, Eunsol Choi, Rachel Rudinger, Jordan Boyd-Graber · arXiv (2026) · doi:10.48550/arxiv.2608.29887 · gemini-3.1-flash-lite
psychometric_modeling
What Makes Something Hard(er)? Explaining Question Difficulty in Natural Language
Peng Cui, Qiaoyuan Zheng, Rudolf Debelak, Mrinmaya Sachan · arXiv (2026) · doi:10.48550/arxiv.2610.01627 · gemini-3.1-flash-lite