<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0">
  <channel>
    <title>AI in Education &amp; AI-Resilient Assessment</title>
    <link>https://ai.elearning.sumdu.edu.ua</link>
    <description>Daily research digest on AI in education and technical countermeasures</description>
    <item>
      <title>Towards Scalable Measurement of Durable Skills</title>
      <link>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2609.15864</link>
      <description>Durable skills, such as collaboration, creativity and critical thinking, are instrumental to success in the modern workforce. Yet, measuring these skills remains a persistent challenge. Moreover, because what is not measured is often not taught, these skills are often overlooked in mainstream educat</description>
      <guid>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2609.15864</guid>
    </item>
    <item>
      <title>Does AI Assistance Leave a Temporal Fingerprint? Detecting Overreliance in AI-Assisted Writing and Programming</title>
      <link>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2609.17883</link>
      <description>The rapid adoption of generative AI has made final artifacts unreliable evidence of student learning, and AI detectors that examine only the finished product are inaccurate and ethically contentious. Process data offers an alternative, but prior work covers only English essay writing. We ask whether</description>
      <guid>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2609.17883</guid>
    </item>
    <item>
      <title>Explainable AI Isn&#39;t Enough! Rethinking Algorithmic Contestability</title>
      <link>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2605.16041</link>
      <description>Machine learning systems increasingly make life-changing decisions about individuals, such as loan approvals, hiring, and cheating detection, raising a pressing question: how can individuals respond to negative decisions made by these opaque systems? While explainable artificial intelligence (XAI) h</description>
      <guid>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2605.16041</guid>
    </item>
    <item>
      <title>Why AI Detection Fails for Academic Integrity</title>
      <link>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2608.11256</link>
      <description>Institutions use commercial AI detectors for academic integrity, yet detectors cannot distinguish AI editing from full LLM drafts and may treat both as misconduct. In a controlled study of published English abstracts (four domains; 2013 to 2015 vs. 2023 to 2025), we quantify this policy failure unde</description>
      <guid>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2608.11256</guid>
    </item>
    <item>
      <title>Extending Item Response Theory for Efficient and Meaningful Multilingual Evaluation</title>
      <link>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2606.15643</link>
      <description>Multilingual benchmarks are central to evaluating large language models (LLMs) across languages, but they suffer from three issues: exhaustive evaluation scales linearly with the number of languages, automatic translation introduces errors that are easily missed at scale, and some items conflate gen</description>
      <guid>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2606.15643</guid>
    </item>
    <item>
      <title>CalibratedRubric: Task-Adaptive Rubric Banks for Open-Ended LLM Evaluation</title>
      <link>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2607.29252</link>
      <description>Reliable evaluation of open-ended LLM outputs requires fine-grained rubrics, yet expert curation is costly and difficult to scale. Existing automated pipelines rely on strict judge unanimity and binary variance filters, which cannot distinguish measurable rubrics from informative ones. We introduce </description>
      <guid>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2607.29252</guid>
    </item>
    <item>
      <title>Which AI model is truly the best: how reliable are public benchmarks of frontier AI models?</title>
      <link>https://ai.elearning.sumdu.edu.ua/uk/doi/10.5281/zenodo.22998204</link>
      <description>Public leaderboards order AI models by a point score and the public debate about them turns on leads of one or two points. We ask how many of those leads the benchmarks can detect. Using only the item-level results that the benchmarks themselves publish, we computed a psychometric report card for 61</description>
      <guid>https://ai.elearning.sumdu.edu.ua/uk/doi/10.5281/zenodo.22998204</guid>
    </item>
    <item>
      <title>A regularised latent‐class item response model for detecting measurement non‐invariance in ordinal response scales</title>
      <link>https://ai.elearning.sumdu.edu.ua/uk/doi/10.1111/bmsp.70076</link>
      <description>Abstract Measurement non‐invariance arises when the psychometric properties of a scale differ across subgroups, undermining the validity of group comparisons. At the item level, this manifests as differential item functioning (DIF), where item responses differ across groups after controlling for the</description>
      <guid>https://ai.elearning.sumdu.edu.ua/uk/doi/10.1111/bmsp.70076</guid>
    </item>
    <item>
      <title>SWIM: Student Writing Simulation via Proficiency-Conditioned Generation</title>
      <link>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2609.03215</link>
      <description>Writing proficiency manifests in how students develop content, organize ideas, choose words, and use language. Despite growing interest in LLM-based student simulation, whether LLMs can reproduce such multidimensional variation in extended writing remains largely unexplored. In this work, we explore</description>
      <guid>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2609.03215</guid>
    </item>
    <item>
      <title>From Scoring to Explanations: Evaluating SHAP and LLM Rationales for Rubric-based Teaching Quality Assessment</title>
      <link>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2606.05180</link>
      <description>Automated scoring models are increasingly used to assign rubric-based quality ratings to complex language performances, including classroom transcripts, yet they typically provide little insight into why a particular score is produced. We propose a general framework for sentence-level interpretabili</description>
      <guid>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2606.05180</guid>
    </item>
    <item>
      <title>Prompt Sensitivity in LLM-Based Essay Scoring is Model-Specific</title>
      <link>https://ai.elearning.sumdu.edu.ua/uk/doi/10.5281/zenodo.21039771</link>
      <description>The emergence of Large Language Models (LLMs) has renewed interest in automated essay scoring, yet a barrier to adoption persists: LLM-generated scores are sensitive to prompt formulation, and it is unclear which aspects of a prompt drive this effect or whether findings from one model or institution</description>
      <guid>https://ai.elearning.sumdu.edu.ua/uk/doi/10.5281/zenodo.21039771</guid>
    </item>
    <item>
      <title>Algorithmic drift in generative adaptive learning</title>
      <link>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2610.31041</link>
      <description>Generative artificial intelligence promises to democratize personalized tutoring, yet the longitudinal stability of adaptive systems remains under-theorized. Current ethical discourse focuses on static bias. This paper argues that a distinct threat lies in algorithmic drift: a feedback loop in which</description>
      <guid>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2610.31041</guid>
    </item>
    <item>
      <title>Agreement Metrics for LLM-as-Judge Evaluation: What to Report and Why</title>
      <link>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2606.00093</link>
      <description>Whether a rubric-based LLM judge can replace human annotation is decided by its measured agreement with human labels. Yet the same verdicts can support wildly varying agreement numbers, depending on seemingly minor choices: the judgment scale, the retained cases, the handling of abstentions and inva</description>
      <guid>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2606.00093</guid>
    </item>
    <item>
      <title>Inside the Scorer: Mechanistic Evidence on Rubric Control in LLM-Based Automated Essay Scoring from 25 Base Models</title>
      <link>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2610.25724</link>
      <description>Automated essay scoring (AES) using large language models (LLMs) offers promising use cases for language assessment, yet high-stakes testing requires scores that are both controllable and verifiable, which current LLM-based scorers lack. Given that, we investigate whether LLM-based scorers form dist</description>
      <guid>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2610.25724</guid>
    </item>
    <item>
      <title>Auditing LLM Benchmarks with Item Response Theory</title>
      <link>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2605.30504</link>
      <description>LLM benchmark labels are frozen at release and silently propagated into downstream benchmarks, errors and all. We introduce an Item Response Theory-based indicator that surfaces likely mislabels at 95% precision in the top 200 examples across seven preference and multiple-choice benchmarks using res</description>
      <guid>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2605.30504</guid>
    </item>
    <item>
      <title>Spatial-Sign based High dimensional Change Point Inference</title>
      <link>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2504.19306</link>
      <description>High-dimensional changepoint inference, adaptable to diverse alternative scenarios, has attracted significant attention in recent years. In this paper, we propose an adaptive and robust approach to changepoint testing. Specifically, by generalizing the classical mean-based cumulative sum (CUSUM) sta</description>
      <guid>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2504.19306</guid>
    </item>
    <item>
      <title>MS-Exam-Gen: Source-Grounded Benchmark Construction for Evaluating LLMs on Textual Multiple Sclerosis MRI Knowledge</title>
      <link>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2610.06170</link>
      <description>Biomedical large language model (LLM) evaluation requires auditable assessment of narrow, evolving, source-grounded subspecialty knowledge. Multiple sclerosis MRI (MS-MRI) provides a high-stakes textual-knowledge test case because correct reasoning requires current diagnostic criteria, standardized </description>
      <guid>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2610.06170</guid>
    </item>
    <item>
      <title>EVOL: Simulator-Guided Evolutionary Expert Synthesis for Deployment-Free Learning Path Recommendation</title>
      <link>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2610.03273</link>
      <description>Reinforcement learning (RL) for learning path recommendation (LPR) faces two coupled obstacles. First, the policy must commit to a sequence of L concepts without intermediate feedback, producing a combinatorial search space that grows super-exponentially with L and provides reward only at the final </description>
      <guid>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2610.03273</guid>
    </item>
    <item>
      <title>Representational Control over Self-Report &amp; Behavior Coherence in LLM Risk-Taking</title>
      <link>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2610.04125</link>
      <description>Self-report is an appealing low-cost probe of an LLM&#39;s dispositions, but recent work finds only selective agreement between what models report and how they behave. Prior accounts establish these patterns by prompting black-box LLMs, leaving open whether the gap is a prompting artefact or a fact abou</description>
      <guid>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2610.04125</guid>
    </item>
    <item>
      <title>What Makes Something Hard(er)? Explaining Question Difficulty in Natural Language</title>
      <link>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2610.01627</link>
      <description>Difficulty is one of the most fundamental properties of a question: it determines whether the question can meaningfully discriminate between models of differing ability. Although a variety of methods can now estimate or predict difficulty automatically, they yield only a single descriptive number, w</description>
      <guid>https://ai.elearning.sumdu.edu.ua/uk/doi/10.48550/arxiv.2610.01627</guid>
    </item>
  </channel>
</rss>