psychometric_modeling

Algorithmic drift in generative adaptive learning

Authors: Firuz Kamalov, Hana Sulieman, Ahmed El Sayed, Sivaraj R., Nitesh Sughnani
Venue / Source: arXiv (2026)

Slight grading biases in adaptive AI tutors compound over time, trapping linguistically diverse students in remedial loops.

Key takeaways

Asymmetric false-negative grading errors in language models create self-reinforcing loops that systematically lower curriculum difficulty for affected demographic groups.
Mathematical modeling proves that adaptive tutoring policies targeting fixed success rates exhibit a bifurcation leading to geometric ability decay above a critical noise threshold.
Standard reinforcement learning exploration baselines such as epsilon-greedy and Thompson sampling fail to close the resulting demographic achievement gap.
Periodic diagnostic probes combined with capability ratchets effectively prevent long-term trajectory decoupling within simulated adaptive learning environments.

Executive Summary (TL;DR)

In plain words In the paper's terms

When an AI grading student work misinterprets non-standard English phrasing, it marks correct answers wrong slightly more often. In an adaptive learning system, this small error causes the AI to repeatedly assign easier remedial content, slowing the student's actual learning progress over time. The authors demonstrate this compounding harm mathematically and introduce a targeted probing mechanism that checks student mastery and restores fair learning pathways.

Adaptive tutoring systems using generative AI risk algorithmic drift when minor, demographically asymmetric observation errors in free-text grading compound recursively over time. The authors model the learner-tutor dyad analytically and via agent-based Monte Carlo simulations with online Rasch and LSTM deep-knowledge-tracing estimators, calibrated against an empirical matched-pair evaluation of three open-weight language models. The empirical grader exhibited a 5 percentage point asymmetric false-negative rate, which in simulation induced trajectory collapse that generic reinforcement learning exploration failed to resolve but a targeted temporal fairness stabilizer mitigated.

Authors' abstract (original)

Generative artificial intelligence promises to democratize personalized tutoring, yet the longitudinal stability of adaptive systems remains under-theorized. Current ethical discourse focuses on static bias. This paper argues that a distinct threat lies in algorithmic drift: a feedback loop in which minor, demographically asymmetric observation errors compound over time into systemic inequities. We make three contributions. First, we formalize algorithmic drift as a coupled learner--tutor dynamical system. Second, we corroborate this theory with an agent-based Monte Carlo simulation in which either a transparent online tracker or an LSTM deep-knowledge-tracing network drives an IRT-based curriculum policy. Third, we introduce the temporal fairness stabilizer (TFS), a targeted intervention that periodically re-probes learner capability, and benchmark it against standard exploration baselines with explicit group-fairness metrics and replication-level inference. Within the modeled environment, TFS closes the achievement gap where generic exploration does not, and we characterize the conditions under which it succeeds. We separate what is established analytically, what is demonstrated in simulation, and what remains to be validated with real learners. Our results reframe algorithmic fairness in education as a temporal property of a closed loop rather than a deployment-time checkbox.

Quality & Relevance Evaluation Breakdown

Novelty

7.5/10

Methodological Rigor

7.5/10

Engineering Countermeasures

7.5/10

Consensus Challenge

7.0/10

Topic Relevance

7.5/10

Relevance for Educators & Research

Provides a formal mathematical framework and simulation testbed for studying item parameter drift and latent ability distortion under automated AI scoring channels.
Demonstrates the longitudinal threat of differential rater bias when foundational LLMs are integrated directly into computerized adaptive testing and knowledge tracing loops.
Offers an explicit algorithmic countermeasure (Temporal Fairness Stabilizer) that psychometricians can adapt to prevent self-reinforcing remedial feedback loops.

Methodology and Dataset

Theoretical dynamical-systems formulation combined with an agent-based Monte Carlo simulation of N=10,000 synthetic learner agents across 100 time steps and 50 independent replications per condition. Synthetic learners were divided into an 80% reference group and a 20% protected group with identical baseline ability distributions. Tested estimators included an online maximum-likelihood Rasch tracker and an LSTM deep-knowledge-tracing network (hidden size 200). Observation noise was empirically calibrated via a matched-pair bank of 40 correct and 20 incorrect physics/science responses across three open-weight models: Qwen2.5-7B-Instruct, Phi-4-mini-instruct, and Mistral-7B-Instruct-v0.3. Baselines included unmitigated control, epsilon-greedy, UCB, and Thompson sampling.

Why Worth Reading

This paper bridges psychometrics, dynamical systems, and generative AI by proving that algorithmic fairness in adaptive learning cannot be treated as a static deployment check. It formalizes how sequential, closed-loop item selection amplifies minor automated scoring errors into compounding educational inequality, providing both theoretical proofs and an engineering countermeasure.

Key Claims & Verified Quotes

Asymmetric false-negative observation noise induces a mathematical bifurcation leading to geometric ability decay in adaptive learning policies.

Quote: “In a reduced mean-field model we prove that an adaptive policy targeting a fixed success rate exhibits a bifurcation under an asymmetric false-negative channel.” — 10.48550/arxiv.2610.31041, p. 1, para. 6 (exact)

The Temporal Fairness Stabilizer mitigates algorithmic drift and eliminates the widening learning gap where standard reinforcement learning exploration fails. overclaim

Quote: “Within the modeled environment, TFS closes the achievement gap where generic exploration does not, and we characterize the conditions under which it succeeds.” — 10.48550/arxiv.2610.31041, p. 1, para. 6 (exact)

Limitations & Study Design Flags

No adversarial testing: not mentioned in the text

The empirical grading evaluation relied on a small, author-constructed item bank of 40 pairs rather than authentic student responses across diverse natural settings.
The longitudinal dynamics were evaluated on synthetic learner agents with simplified Item Response Theory updates rather than real human classroom deployments.
The simulation assumed non-punitive diagnostic probes, whereas actual students may suffer emotional frustration or disengagement from unexpected difficult items.

Model inference (gaps & contradictions)

[method / conceptual]: Standard psychometric fairness auditing (e.g., differential item functioning) evaluates static test instruments, whereas this work evaluates closed-loop dynamical feedback between IRT estimation and generative curriculum adaptation.

#algorithmic drift #adaptive learning #knowledge tracing #LLM grading #item response theory #algorithmic fairness #feedback loops