Submit incident
Documented

Turnitin Flagged 22 Million AI-Written Papers. No One Checked Its Math.

April 8, 2024
Curated by Team Raidu · Reviewed by Shiva Ganesh
oecd:77654View source ↗
LinkedInX

What happened

Turnitin scanned 200 million student papers submitted through its platform after rolling out an AI-detection tool in April 2023. A year later, the company reported that more than 22 million of those papers, roughly 11 percent of everything submitted, contained at least a fifth AI-generated text. That's the headline number. The harder question is what happens to a student after it gets attached to their name.

A score like "20 percent AI content" sounds precise. In practice, it's a probability estimate from a proprietary model, applied at scale to millions of essays, with no public account of how often that model gets it wrong on any single paper. Turnitin has never fully disclosed its detection methodology, and independent researchers have repeatedly found AI detectors misfiring on non-native English writers and on human-authored text with unusual structure or phrasing. Multiply even a small error rate across 200 million submissions, and a lot of students end up carrying an accusation nobody outside the company can independently verify.

Universities have leaned on the number anyway. A tool built to catch plagiarism gets treated as evidence in academic misconduct hearings, often without instructors ever seeing the underlying analysis or knowing where the 20 percent threshold came from. Turnitin sets the bar, runs the check, and hands down a verdict, and the school using it rarely has the standing to audit any of it.

That's the actual story here. Students using generative AI to write papers was never really in question. What matters is that an opaque scoring system now carries enough weight to end a semester or a degree, and nobody outside Turnitin can trace how it reached that specific verdict on that specific paper.

Reported impact

Affected parties
Not publicly disclosed
Harm type
Not publicly disclosed
Scale
Not publicly disclosed
Financial impact
Not publicly disclosed
Regulatory action
Not publicly disclosed

Classification

Organization
Not publicly disclosed
AI system
Not publicly disclosed
Industry
Not publicly disclosed
Country
Not publicly disclosed
Provider
Not publicly disclosed
Incident type
Not publicly disclosed

Relevant governance controls

Governance control mapping is not available for this record.

  • No controls mappedNot publicly disclosed

Control mapping is analytical. It does not state that any control would have prevented the incident.

Sources and evidence

This record was researched and written by the Index. The event is also catalogued in the following database, which is listed for cross-reference.

OECD AI Incidents Monitor
Also catalogued in
Turnitin Flagged 22 Million AI-Written Papers. No One Checked Its Math.
2024-04-08