Watching the watchers: bias and vulnerability in remote proctoring software
Authors: Ben Burgess, Avi Ginsberg, Edward W. Felten, Shaanan Cohney
Venue / Source: arXiv (2022)
Commercial remote proctoring suites fail to stop competent cheaters while imposing surveillance risks and racially biased identity checks on students.
Key takeaways
- Anti-cheating protections like virtual machine and process blocking are readily circumvented using standard configuration tweaks or renamed executables.
- Examplify's face recognition engine (face-api.js) exhibited a high 11.47% average false non-match rate, risking wrongful lockouts of honest test-takers.
- Facial verification accuracy degraded significantly under natural head tilt, lighting shifts, and across racial groups, disadvantaging minority candidates.
- Proctoring software frequently installs root-level persistent background services that transmit telemetry and expand user attack surfaces post-exam.
- Educators should pivot toward assessment formats that minimize cheating incentives rather than relying on brittle digital surveillance.
Executive Summary (TL;DR)
Authors' abstract (original)
Educators are rapidly switching to remote proctoring and examination software for their testing needs, both due to the COVID-19 pandemic and the expanding virtualization of the education sector. State boards are increasingly utilizing these software for high stakes legal and medical licensing exams. Three key concerns arise with the use of these complex software: exam integrity, exam procedural fairness, and exam-taker security and privacy. We conduct the first technical analysis of each of these concerns through a case study of four primary proctoring suites used in U.S. law school and state attorney licensing exams. We reverse engineer these proctoring suites and find that despite promises of high-security, all their anti-cheating measures can be trivially bypassed and can pose significant user security risks. We evaluate current facial recognition classifiers alongside the classifier used by Examplify, the legal exam proctoring suite with the largest market share, to ascertain their accuracy and determine whether faces with certain skin tones are more readily flagged for cheating. Finally, we offer recommendations to improve the integrity and fairness of the remotely proctored exam experience.
Quality & Relevance Evaluation Breakdown
Relevance for Educators & Research
- Serves as foundational empirical evidence regarding the validity of unproctored vs. algorithmically proctored testing environments under Kane and Messick validity frameworks.
- Demonstrates that automated monitoring creates differential construct-irrelevant difficulty across racial demographics via elevated false accusation rates.
- Provides a strong technical argument supporting assessment redesign (e.g., authentic, open-resource assessments) over technical countermeasures against AI-enabled cheating.
Methodology and Dataset
Static and dynamic reverse engineering using RADARE2 and Ghidra on the four major U.S. legal proctoring suites (Examplify, Exam4, Electronic Blue Book, ILG Exam360), surveying 180 law schools and all U.S. state bar associations. Algorithmic fairness and verification accuracy were benchmarked across four facial datasets: MORPH-II (14k subjects, 55k faces), Multi-PIE (750k images, 337 subjects), LFWA+ (6k subjects, 13k faces), and VGGFace2 (9k subjects, 3M images). Examplify's default model (face-api.js) was evaluated alongside four state-of-the-art baselines: FaceNet, VGG-Face, OpenFace, and ArcFace.
Why Worth Reading
This paper offers a definitive technical teardown of commercial exam proctoring engines, demonstrating that algorithmic surveillance fails fundamental psychometric fairness criteria and creates a false sense of assessment security.
Key Claims & Verified Quotes
Limitations & Study Design Flags
- Evaluation focused strictly on client-side binaries; server-side cheating detection heuristics and telemetric audit routines were not audited.
- Dataset fairness evaluations relied on categorical racial tags rather than fine-grained, objective skin-tone classifications.
- Reference image testing used archival research datasets rather than live webcam streams captured during active high-stakes exam conditions.
- supports Online test administration without proctoring shows measurable score shifts relative to proctored testing environments. «Teclehaimanot, E T A L. [36] performed a meta analysis of test scores recorded in proctored and unproctored environments, finding a 0.20 STD variation between the two sets.», p. 3, para 6
- supports Student trust in institutional mandates significantly depresses active resistance to invasive proctoring software. «Balash, E T A L. [4] who find that trust in institutions substantially reduces the extent to which students are willing to object to remote proctoring.», p. 13, para 8
- [method / conceptual]: Proctoring vendors assume security through client-side restriction, which violates established threat modeling principles against adversaries with physical administrative access.
- [metric / empirical]: Optimizing models for overall accuracy obscures extreme subgroup disparities in false non-match rates, directly compromising Kane's procedural fairness assumption.