psychometric_modeling

Representational Control over Self-Report & Behavior Coherence in LLM Risk-Taking

Authors: Rafal Kocielnik, Peiyang Song, Pengrui Han, Myrl G. Marmarelis, Ramit Debnath, Dean Mobbs, R. Michael Alvarez
Venue / Source: arXiv (2026)

Internal activation steering reveals that an LLM's self-reported risk-taking is fundamentally dissociated from its actual behavioral risk-taking, making self-report a poor, tamper-prone indicator of model behavior.

Key takeaways

  • Internal steering vectors reveal that self-report and actual behavioral choices in models rely on geometrically distinct neural mechanisms.
  • The observed dissociation between stated intentions and actions suggests that traditional self-reporting tasks are unreliable indicators of future AI performance.
  • Intentional composition of steering vectors may enable the creation of models that exhibit deceptive coherence, where reported personality contradicts actual decision-making.
  • Methodological limitations regarding domain generalization and reliance on open-weight models suggest findings may not fully represent complex agentic behaviors in proprietary systems.

Executive Summary (TL;DR)

Wording

Researchers tested whether an AI's claimed personality about taking risks matches its actual choices in gambling games. They found that these two behaviors are controlled by different parts of the AI's internal logic, meaning the AI can be made to say it is cautious while acting recklessly. These results suggest that asking an AI about its intentions is not a reliable way to predict what it will actually do.

This paper investigates the dissociation between LLM self-reports and actual behavior in risk-taking tasks using internal activation steering. It demonstrates that directions steering self-report and behavior are largely geometrically separate, meaning internal interventions typically affect only one channel. While composition of steering directions can induce coherent or anti-coherent responses, the two channels remain weakly coupled at best.

Authors' abstract (original)

Self-report is an appealing low-cost probe of an LLM's dispositions, but recent work finds only selective agreement between what models report and how they behave. Prior accounts establish these patterns by prompting black-box LLMs, leaving open whether the gap is a prompting artefact or a fact about how the underlying constructs are represented internally. We investigate risk-taking, a consequential dimension of agentic decision-making, using activation steering to measure self-report and behavior under the same internal intervention. We survey nine steering-vector extraction methods spanning task-specific directives, the model's own task behavior, and dispositional descriptions at two granularities, evaluated on two behavioral tasks and two psychometric instruments across four open-weight LLMs. We find that (1) a shared internal intervention does not ensure shared responsiveness: directions built from trait descriptions move self-report but leave behavior at chance, directions built from the model's own task choices do the reverse, and only task-specific directives reach both, weakly. (2) Diagnosis dissolves that exception: removing surface confounders leaves the directives only 32% of their behavioral effect. The two channels are otherwise steered by near-orthogonal directions, each channel reachable by several independent constructions. (3) An intervention composing one behavior-moving and one self-report-moving direction moves both together; flipping one sign sets them in opposition, with reported and enacted risk pointing in opposite directions on 69-89% of flipped compositions in all models. These findings move the self-report-behavior relationship from a black-box observation to a representational one that can be inspected and controlled, motivating representational checks alongside behavioral evaluation.

Quality & Relevance Evaluation Breakdown

Novelty
8.0/10
Methodological Rigor
8.0/10
Engineering Countermeasures
7.0/10
Consensus Challenge
5.0/10
Topic Relevance
8.0/10

Relevance for Educators & Research

  • Provides a methodology for validating assessments against model internals.
  • Contributes to the theory of AI-resilient assessment by showing that self-reporting behaviors can be decoupled from actual performance.
  • Offers a quantitative framework for analyzing item compromise and concept drift in AI-generated responses.

Methodology and Dataset

The study tested four open-weight LLMs (Qwen2.5-7B, Llama3.1-8B, OLMo-3-7B, and Ministral-3-8B). Risk-taking was measured via the Columbia Card Task (CCT) and Balloon Analogue Risk Task (BART), while self-report was assessed via BFI-44 and DOSPERT. The study analyzed nine steering-vector extraction methods spanning task directives, model choices, and personality descriptions.

Why Worth Reading

This paper provides a rare, rigorous mechanistic diagnosis of the 'value-action' gap in LLMs. By using activation steering to test internal representations, it moves beyond superficial prompt-based observations and offers a framework for 'mechanistically informed behavioral auditing' which is essential for educators concerned with AI-resilient assessments.

Key Claims & Verified Quotes

Steering directions built from trait descriptions move self-report but not behavioral decisions.
Quote: “directions built from trait descriptions move self-report but leave behavior at chance” — 10.48550/arxiv.2610.04125, p. 1, para. 7 (exact)
A change in a steered model's self-report is not a reliable indicator of a change in its behavior.
Quote: “A change in what a steered model says about its risk-taking is not a reliable sign of a change in what it does.” — 10.48550/arxiv.2610.04125, p. 5, para. 9 (exact)

Limitations & Study Design Flags

  • The study focuses on a single construct (risk-taking), which, while consequential for decision-making, may not generalize to all cognitive domains.
  • Surface-level shortcut controls are necessarily incomplete, meaning the reported dissociation might be understated.
  • The study uses only open-weight models; steering mechanisms in proprietary frontier models cannot be evaluated with current activation access methods.
  • Behavioral evaluation is based on single task decisions rather than complex, multi-step agentic trajectories.
Model inference (gaps & contradictions)
  • [Method / methodological]: The study contrasts its internal steering approach with previous prompting-only studies, arguing that prompting cannot distinguish between representational gaps and elicitation confounds.