quasi_experiment

Does AI Assistance Leave a Temporal Fingerprint? Detecting Overreliance in AI-Assisted Writing and Programming

Authors: Eduardo Davalos, Yike Zhang
Venue / Source: arXiv (2026)

Wholesale AI delegation leaves a distinct temporal fingerprint in process logs, but authentic collaborative AI use is virtually indistinguishable from human-only work.

Key takeaways

Temporal analysis reveals distinct patterns of burst productivity that reliably differentiate wholesale delegation of tasks to AI from collaborative human-AI interactions.
Detection accuracy remains high for simulated delegation, though the current evidence base relies on lab-simulated conditions rather than authentic student behaviors.
The tendency to retain AI-generated content varies significantly between prose writing and programming, suggesting assessment risks should be evaluated as domain-specific phenomena.
Process-level keystroke data may offer a privacy-preserving mechanism to trigger formative pedagogical conversations about academic integrity rather than serving as definitive evidence of misconduct.

Executive Summary (TL;DR)

In plain words In the paper's terms

The paper finds that using AI to do entire assignments ('delegation') leaves a clear footprint in how students type or code, while using it as a collaborative partner does not. Because of this, it is possible to accurately flag instances where the AI did all the work by looking at simple speed and timing data. The authors argue that educators should use these logs to open conversations with students rather than treating them as automatic proof of cheating.

Generative AI assistance leaves a consistent temporal signature across writing and programming characterized by bursts of content that exceed human baseline productivity. Wholesale delegation of tasks to AI is separable from authentic work with over 99% accuracy using observable process features, whereas collaborative AI use remains indistinguishable from unassisted work. Process visibility offers a scalable, privacy-respecting evidentiary basis for identifying academic dishonesty rather than tool usage.

Authors' abstract (original)

The rapid adoption of generative AI has made final artifacts unreliable evidence of student learning, and AI detectors that examine only the finished product are inaccurate and ethically contentious. Process data offers an alternative, but prior work covers only English essay writing. We ask whether AI assistance carries a temporal signature, whether it generalizes from writing to programming, and whether it distinguishes ordinary collaboration from wholesale delegation. We analyze three public corpora: CoAuthor (1,447 keystroke-level co-writing sessions), RealHumanEval (editor telemetry from 243 programmer records), and a pre-LLM CS1 corpus (5.1 million keystrokes) as a human-only baseline, comparing minimal-AI work, collaborative AI use, and simulated wholesale delegation. Three findings emerge. First, the signature generalizes: AI contributions arrive in bursts far outside the author's own baseline in both mediums (paired d_z = 1.13 and 3.54). Second, engagement diverges by medium: 93% of AI-inserted characters survived to writers' final documents, while only 14% of accepted code suggestions survived intact. Third, classifiers using only observable temporal features separate simulated delegation from authentic work nearly perfectly (F1 $\geq$ 0.997; at most 0.5% of real work misclassified), while ordinary collaboration remains hard to distinguish from unassisted work. Temporal evidence flags wholesale delegation rather than assistance, positioning process visibility as a candidate evidentiary basis for academic integrity, pending validation in authentic coursework.

Quality & Relevance Evaluation Breakdown

Novelty

7.0/10

Methodological Rigor

8.0/10

Engineering Countermeasures

7.0/10

Consensus Challenge

6.0/10

Topic Relevance

9.0/10

Relevance for Educators & Research

Provides a methodology for modeling student engagement via process telemetry.
Demonstrates how to distinguish between legitimate 'collaborative' use of LLMs and 'delegation' in assessment.
Offers a framework for 'process visibility' that aligns with validity arguments focused on student performance indicators.

Methodology and Dataset

The study analyzed three public corpora: CoAuthor (1,447 sessions by 63 writers), RealHumanEval (243 programmer records, with 45 used for paired analysis), and an external CS1 keystroke baseline (5.1 million keystrokes, N=487). The researchers compared these with a simulated wholesale delegation condition involving 400 writing sessions and 150 programming traces.

Why Worth Reading

This paper provides a rare cross-domain quantitative analysis of temporal fingerprints in AI-assisted work, establishing a rigorous psychometric distinction between 'collaboration' and 'wholesale delegation' that could redefine academic integrity policies.

Key Claims & Verified Quotes

AI contributions arrive in temporal bursts that significantly exceed the author's own baseline typing or coding patterns.

Quote: “AI contributions arrive in bursts far outside the author's own baseline in both mediums (paired dz = 1.13 and 3.54).” — 10.48550/arxiv.2609.17883, p. 1, para. 8 (exact)

Temporal process data can distinguish wholesale delegation from collaborative work with high precision. overclaim

Quote: “classifiers using only observable temporal features separate simulated delegation from authentic work nearly perfectly” — 10.48550/arxiv.2609.17883, p. 1, para. 8 (exact)

Limitations & Study Design Flags

The delegation condition is simulated rather than observed in the wild.
Timing features can potentially be evaded by paced retyping or timing forgery attacks.
No outcome data links the detected behaviors directly to learning harm.
Dataset limitations include the 30-token suggestion cap in CoAuthor and the small number of paired programming records.

Model inference (gaps & contradictions)

[method / simulation limitations]: The authors acknowledge that the simulated 'wholesale delegation' creates a categorical signature that is structurally distinct, which potentially overstates detection performance in authentic, noisy environments.

#academic integrity #process mining #learning analytics #keystroke dynamics #AI overreliance