Inside the Scorer: Mechanistic Evidence on Rubric Control in LLM-Based Automated Essay Scoring from 25 Base Models
Authors: Chungche Huang, Po-Ya Angela Wang, Shu-Kai Hsieh
Venue / Source: arXiv (2026)
Scoring essay rubrics with language models relies on a single shared lever rather than separate internal controls.
Key takeaways
- Holistic essay scores are reliably decodable from residual stream activations in longer essays, but decodability fades sharply in the final layers.
- Internal representations of analytic rubrics separate geometrically in longer essays but collapse entirely in short-answer tasks.
- Causal steering of internal activations reveals that models adjust scores using a single general quality lever rather than trait-specific controls.
- High human-machine score correlation does not prove that an automated rater actually measures or controls distinct analytic rubrics.
- End-to-end automated scoring risks reproducing human rater halo effects without providing genuine subconstruct verifiability.
Executive Summary (TL;DR)
Authors' abstract (original)
Automated essay scoring (AES) using large language models (LLMs) offers promising use cases for language assessment, yet high-stakes testing requires scores that are both controllable and verifiable, which current LLM-based scorers lack. Given that, we investigate whether LLM-based scorers form distinct internal representations for individual scoring rubrics and whether these representations can be independently controlled. Probing and steering 25 open-weight base LLMs (0.13B-10.31B parameters; 14 families) on human-scored BESTEP English writing tasks, we find that holistic scores are decodable from model activations for the longer tasks (Parts 2 and 3) and only weakly for the shortest (Part 1). Furthermore, scoring rubrics have partly separable directions in representation space for the longer tasks, though not for short responses (Part 1). However, causal steering reveals a critical limitation: applying a matching intervention (e.g., steering "grammar" on a grammar-degraded response) yields only a negligible advantage (about 2% of the effect) over a mismatched intervention (e.g., steering "vocabulary"), and none that is detectable in any of the 10 testable comparisons across reliably measured rubrics. Rather than controlling distinct evaluative dimensions, the rubric directions share a dominant lever whose rubric-specific parts are not selective, which may mirror the halo structure of human ratings. Our contributions are two-fold. First, we show that analytic scoring rubrics designed for human raters do not behave as independent controls in base LLMs, even among the seven models whose scores agree best with human raters ($r \geq 0.6$). Second, we establish a methodology that shows that score agreement and decodability do not imply rubric-level control in LLM-based assessment.
Quality & Relevance Evaluation Breakdown
Relevance for Educators & Research
- Crucial evidence for validity arguments (Kane and Messick) regarding construct representation and construct-irrelevant variance in AI raters.
- Demonstrates psychometric rater drift and halo phenomena manifesting within transformer hidden layers.
- Informs AI-resilient assessment architecture by demonstrating why decomposed modular pipelines are strictly required over end-to-end LLM scoring.
Methodology and Dataset
75 human-rated student writing responses from the official BESTEP English examination (undergraduate academic proficiency test in Taiwan) across two test forms and three task types (short answer N=21, opinion email N=24, integrated essay N=30), plus 104 verified rubric-degraded essay variants generated by Llama 3.3 (70B) from 26 high-band gold essays. Evaluated on 25 open-weight base LLMs (0.13B to 10.31B parameters, 16 to 42 layers) across 14 model families using layer-wise Ridge regression probing with leave-one-out cross-validation and 1,000 score permutations, disattenuated cosine direction similarities, and 74,304 paired causal activation steering interventions.
Why Worth Reading
It provides the first mechanistic interpretability audit of rubric control in automated essay scoring, proving that high human-machine score agreement can mask a total absence of independent trait evaluation.
Key Claims & Verified Quotes
Limitations & Study Design Flags
- No adversarial testing: not mentioned in the text
- Evaluation is restricted to base language models; fine-tuned, instruction-tuned, and deployed proprietary commercial scoring models were not tested.
- The primary dataset is limited to 75 essays from a single standardized academic English test (BESTEP).
- Targeted essay degradations were generated by one LLM, which can leave correlated trace artifacts across adjacent linguistic dimensions.
- The gold evaluation set lacked analytic human rubric scores, preventing empirical separation between model collapse and human rater halo error.
- Parameter scale was capped at 10.31B parameters due to local deployment constraints, omitting frontier-scale models.
- supports Decodability of a property from internal activations does not establish that the model causally utilizes it in computation. «First, Elazar et al. (2021) demonstrate that a property’s being decodable from a representation does not mean the model actually uses it.», p. 3, para 3
- supports Probe performance requires validation against selectivity baselines to ensure genuine feature control. «Second, Hewitt and Liang (2019) show that probe accuracy is uninterpretable without a selectivity check against a memorization-based control task.», p. 3, para 3
- [method / conceptual blindspot]: Studies that validate LLM automated essay scorers purely through correlation or Rasch/G-theory reliability metrics overlook internal rater mechanics and multidimensional validity.
- [definition / untested assumption]: Prompting LLMs to output analytic rubric sub-scores assumes internal trait separation, which this study empirically refutes in base models.