psychometric_modeling

SWIM: Student Writing Simulation via Proficiency-Conditioned Generation

Authors: Heejin Do, Jakub Kontak, Mrinmaya Sachan
Venue / Source: arXiv (2026)

Reinforcement learning with automated essay scoring rewards allows LLMs to simulate students of specific proficiency levels more realistically than prompting alone.

Key takeaways

Rubric-grounded prompting is insufficient for controlling fine-grained linguistic and structural aspects of writing.
Supervised fine-tuning significantly improves proficiency alignment compared to prompting by learning from authentic score-essay pairs.
The Proficiency Alignment Reward (PAR) enables reinforcement learning to further refine and balance writing traits simultaneously.
Models better reproduce high-proficiency writing than low-proficiency writing, often struggling to simulate authentic grammatical and structural errors in low-proficiency targets.
RL gains generalize across different, independently trained automated essay scoring models, suggesting robust proficiency-conditioned behavior.

Executive Summary (TL;DR)

In plain words In the paper's terms

This research explores whether AI can realistically mimic how students of different writing abilities write. The authors show that simple prompting is ineffective for this, but training models on pairs of essays and their scores significantly improves the result. The study provides a new method for creating more accurate AI student simulators.

This study introduces SWIM, a framework that models student writing as proficiency-conditioned essay generation across various writing traits. It systematically compares prompting, supervised fine-tuning, and reinforcement learning with a proposed Proficiency Alignment Reward (PAR). Quantitative results demonstrate that while prompting provides limited control, explicit reward-based optimization consistently improves alignment between target proficiency profiles and generated essay characteristics.

Authors' abstract (original)

Writing proficiency manifests in how students develop content, organize ideas, choose words, and use language. Despite growing interest in LLM-based student simulation, whether LLMs can reproduce such multidimensional variation in extended writing remains largely unexplored. In this work, we explore if language models can realistically simulate student writing, and introduce SWIM, a task that formulates Student Writing sIMulation as proficiency-conditioned essay generation. We evaluate prompting, supervised fine-tuning (SFT), and reinforcement learning (RL) methods for writing simulation using automated essay scoring as a measure of profile alignment. Extensive experiments reveal that prompting provides limited proficiency control, even for strong proprietary LLMs with rubric-grounded strategies. In particular, while models can adjust content-oriented traits, they struggle to reproduce the lexical, grammatical, and organizational variation in different proficiency levels. SFT substantially improves alignment, while RL with the proposed proficiency-alignment reward yields further gains across all writing traits and essay prompts. Our findings suggest that explicit supervision enables substantially stronger profile alignment than prompting alone, while authentic low-proficiency writing remains challenging to reproduce.

Quality & Relevance Evaluation Breakdown

Novelty

7.0/10

Methodological Rigor

8.0/10

Engineering Countermeasures

8.0/10

Consensus Challenge

5.0/10

Topic Relevance

8.0/10

Relevance for Educators & Research

Provides a scalable method for simulating diverse student performance levels in assessment contexts.
Identifies specific linguistic features where LLMs fail to replicate student-typical performance, informing the development of more robust assessment-resilient systems.
Demonstrates the efficacy of reward-based alignment techniques for controlling LLM output in educational applications.

Methodology and Dataset

The study uses the ASAP/ASAP++ dataset (N=~14,000 essays across 8 prompts). Methods include rubric-grounded prompting (CTP and SRLP), supervised fine-tuning (SFT), and reinforcement learning via GRPO using a Proficiency Alignment Reward (PAR). Models tested include Claude Sonnet, GPT-5, Qwen2.5-7B, and Qwen3-4B.

Why Worth Reading

This paper provides a rigorous, state-of-the-art methodology for generating synthetic learner data, which is essential for training educational AI systems. It offers crucial insights into the limitations of current LLMs in mimicking specific student performance levels, which is vital for practitioners designing AI-based educational interventions.

Key Claims & Verified Quotes

Direct supervision from authentic score-essay pairs is significantly more effective than rubric-based prompting for proficiency control.

Quote: “Direct supervision from authentic score–essay pairs proves far more effective than rubric descriptions alone, enabling open-source 7B and 4B models to move from near-random alignment under prompting to meaningful proficiency control.” — 10.48550/arxiv.2609.03215, p. 2, para. 2 (exact)

GRPO with PAR consistently improves simulation fidelity across all writing traits and prompts.

Quote: “GRPO with the proposed PAR further improves alignment across every writing trait and essay prompt, producing more balanced profile-level generation.” — 10.48550/arxiv.2609.03215, p. 2, para. 2 (exact)

Models struggle to reproduce authentic low-proficiency writing.

Quote: “models reproduce high-proficiency writing more faithfully than low-proficiency writing” — 10.48550/arxiv.2609.03215, p. 2, para. 2 (exact)

Limitations & Study Design Flags

Evaluation relies on AES model proxies, which may not capture all dimensions of authentic student writing.
Experiments are limited to the ASAP/ASAP++ dataset, potentially limiting generalizability to other educational contexts or languages.
Student writing is modeled as static proficiency profiles, ignoring longitudinal changes or evolving student states.

From the article text (quote verified)

supports Instruction-tuned models are optimized to produce fluent and well-formed text, which acts as a bottleneck for simulating lower-proficiency writing. «This inductive bias, consistent with the tendency of aligned LLMs to produce polished, helpful, and well-formed outputs (Ouyang et al., 2022; Bai et al., 2022), is beneficial for most generation tasks», p. 7, para 15

Model inference (gaps & contradictions)

[method / behavioral realism vs score alignment]: While PAR significantly improves AES-measured trait alignment, the paper identifies that this does not solve the qualitative failure of models to generate authentic low-proficiency structural errors.

#student simulation #automated essay scoring #reinforcement learning #controllable generation #educational AI