Representational Control over Self-Report & Behavior Coherence in LLM Risk-Taking
Authors: Rafal Kocielnik, Peiyang Song, Pengrui Han, Myrl G. Marmarelis, Ramit Debnath, Dean Mobbs, R. Michael Alvarez
Venue / Source: arXiv (2026)
Internal activation steering reveals that an LLM's self-reported risk-taking is fundamentally dissociated from its actual behavioral risk-taking, making self-report a poor, tamper-prone indicator of model behavior.
Key takeaways
- Internal steering vectors reveal that self-report and actual behavioral choices in models rely on geometrically distinct neural mechanisms.
- The observed dissociation between stated intentions and actions suggests that traditional self-reporting tasks are unreliable indicators of future AI performance.
- Intentional composition of steering vectors may enable the creation of models that exhibit deceptive coherence, where reported personality contradicts actual decision-making.
- Methodological limitations regarding domain generalization and reliance on open-weight models suggest findings may not fully represent complex agentic behaviors in proprietary systems.
Executive Summary (TL;DR)
Authors' abstract (original)
Self-report is an appealing low-cost probe of an LLM's dispositions, but recent work finds only selective agreement between what models report and how they behave. Prior accounts establish these patterns by prompting black-box LLMs, leaving open whether the gap is a prompting artefact or a fact about how the underlying constructs are represented internally. We investigate risk-taking, a consequential dimension of agentic decision-making, using activation steering to measure self-report and behavior under the same internal intervention. We survey nine steering-vector extraction methods spanning task-specific directives, the model's own task behavior, and dispositional descriptions at two granularities, evaluated on two behavioral tasks and two psychometric instruments across four open-weight LLMs. We find that (1) a shared internal intervention does not ensure shared responsiveness: directions built from trait descriptions move self-report but leave behavior at chance, directions built from the model's own task choices do the reverse, and only task-specific directives reach both, weakly. (2) Diagnosis dissolves that exception: removing surface confounders leaves the directives only 32% of their behavioral effect. The two channels are otherwise steered by near-orthogonal directions, each channel reachable by several independent constructions. (3) An intervention composing one behavior-moving and one self-report-moving direction moves both together; flipping one sign sets them in opposition, with reported and enacted risk pointing in opposite directions on 69-89% of flipped compositions in all models. These findings move the self-report-behavior relationship from a black-box observation to a representational one that can be inspected and controlled, motivating representational checks alongside behavioral evaluation.
Quality & Relevance Evaluation Breakdown
Relevance for Educators & Research
- Provides a methodology for validating assessments against model internals.
- Contributes to the theory of AI-resilient assessment by showing that self-reporting behaviors can be decoupled from actual performance.
- Offers a quantitative framework for analyzing item compromise and concept drift in AI-generated responses.
Methodology and Dataset
The study tested four open-weight LLMs (Qwen2.5-7B, Llama3.1-8B, OLMo-3-7B, and Ministral-3-8B). Risk-taking was measured via the Columbia Card Task (CCT) and Balloon Analogue Risk Task (BART), while self-report was assessed via BFI-44 and DOSPERT. The study analyzed nine steering-vector extraction methods spanning task directives, model choices, and personality descriptions.
Why Worth Reading
This paper provides a rare, rigorous mechanistic diagnosis of the 'value-action' gap in LLMs. By using activation steering to test internal representations, it moves beyond superficial prompt-based observations and offers a framework for 'mechanistically informed behavioral auditing' which is essential for educators concerned with AI-resilient assessments.
Key Claims & Verified Quotes
Limitations & Study Design Flags
- The study focuses on a single construct (risk-taking), which, while consequential for decision-making, may not generalize to all cognitive domains.
- Surface-level shortcut controls are necessarily incomplete, meaning the reported dissociation might be understated.
- The study uses only open-weight models; steering mechanisms in proprietary frontier models cannot be evaluated with current activation access methods.
- Behavioral evaluation is based on single task decisions rather than complex, multi-step agentic trajectories.
- [Method / methodological]: The study contrasts its internal steering approach with previous prompting-only studies, arguing that prompting cannot distinguish between representational gaps and elicitation confounds.