Papers tagged with: #reliability

7.5
assessment_design

Synthetic Worldview Reconstruction (SWR): A Methodological Framework for LLM-Assisted Group-Level Belief System Analysis

Lukas Geiger · Zenodo (CERN European Organization for Nuclear Research) (2026) · doi:10.5281/zenodo.18736720 · gemini-3.1-flash-lite

Read full analysis →

7.5
assessment_design

EduClaw-Bench: A Long-Horizon Benchmark for Pedagogical LLM Agents with Simulated Learners

Unggi Lee, Sookbun Lee, Yeil Jeong, Eunjoo Lee, Minchul Shin, Hoilym Kwon · arXiv (2026) · doi:10.48550/arxiv.2608.03206 · gemini-3.1-flash-lite

Read full analysis →

7.7
psychometric_modeling

Diagnosing the Reliability of LLM-as-a-Judge via Item Response Theory

Junhyuk Choi, Sohhyung Park, Chanhee Cho, Hyeonchu Park, Bugeun Kim · arXiv (2026) · doi:10.48550/arxiv.2602.00521 · gemini-3.7-flash

Read full analysis →

7.5
assessment_design

Proxy Confidence: Auditing Black-Box LLM Agents with a Surrogate's Log-Probabilities

Yikai Zhao, Saurabh Pandey, Pradeep Kumar Misra · arXiv (2026) · doi:10.48550/arxiv.2610.03894 · gemini-3.1-flash-lite

Read full analysis →

8.0
psychometric_modeling

Agreement Metrics for LLM-as-Judge Evaluation: What to Report and Why

Delip Rao, Chris Callison-Burch · arXiv (2026) · doi:10.48550/arxiv.2606.00093 · gemini-3.8-flash

Read full analysis →