Papers tagged with: #benchmark-validity

8.0
assessment_design

Every Model Cheats: Prompt-Level Mitigation of Cheating on Offensive Cyber Tasks

Michael Kouremetis, Ads Dawson, Raja Sekhar Rao Dheekonda, Brian Greunke · arXiv (2026) · doi:10.48550/arxiv.2607.21763 · gemini-3.1-flash-lite

Read full analysis →

8.0
psychometric_modeling

Laplace-PSN-IRT: Uncertainty Quantification for Neural Item Response Theory Models of LLM Benchmarks

Juan Francisco, Mandujano Reyes · arXiv (2026) · doi:10.48550/arxiv.2607.25257 · gemini-3.1-flash-lite

Read full analysis →

7.5
assessment_design

Do Coding Agents Deceive Us? Detecting and Preventing Cheating via Capped Evaluation with Randomized Tests

Thanawat Lodkaew, Johannes Ackermann, Soichiro Nishimori, Nontawat Charoenphakdee, Masashi Sugiyama, Takashi Ishida · arXiv (2026) · doi:10.48550/arxiv.2606.07379 · gemini-3.1-flash-lite

Read full analysis →

7.2
psychometric_modeling

Extending Item Response Theory for Efficient and Meaningful Multilingual Evaluation

Gili Lior, Tzviel Frostig, Gabriel Stanovsky, Matan Eyal · arXiv (2026) · doi:10.48550/arxiv.2606.15643 · gemini-3.7-flash

Read full analysis →