Submit incident
Documented

Seven AI Books Lied About King Charles' Cancer Diagnosis and Amazon Sold All of Them

January 1, 2024
Curated by Team Raidu · Reviewed by Shiva Ganesh
aiaaic:AIAAIC1331View source ↗
LinkedInX

What happened

In February 2024, seven books appeared for sale on Amazon, each purporting to tell the story of King Charles III's cancer diagnosis. None were authorized. None were accurate. All seven contained fabricated medical details: claims that the King had skin cancer specifically, and that he had suffered an undisclosed accident that had never been reported. According to the Mail on Sunday, the books appeared to have been generated using AI tools and were attributed to unknown authors. Buckingham Palace responded with fury.

The books surfaced within days of the diagnosis being made public. The self-publishing infrastructure Amazon operates through its Kindle Direct Publishing platform processes new submissions continuously and at scale, with automated checks designed to screen for guideline violations. Those checks did not catch seven books built from fabricated claims about a named living person's medical condition. The speed of the pipeline was its selling point and its failure point simultaneously.

Amazon's spokesman told the Mail on Sunday that the company invested "significant time and resources" to ensure content on its platform followed its guidelines, and that AI-generated content violating those guidelines was not permitted. The statement did not address how the specific books had cleared the system, or what mechanism had been in place to catch fabricated medical claims before they became purchasable listings.

This was not the first time the pattern had appeared. In the same period, AI-generated mushroom foraging books with potentially dangerous misidentifications had circulated on Amazon, and fake author pages impersonating the literary agent Jane Friedman had appeared. The recurrence points to a structural problem rather than an occasional slip: automated content generation and automated self-publishing interact in ways that outpace the moderation designed to sit between them.

The King Charles case isolates a gap that content policy alone cannot close. Amazon prohibited AI-generated content that creates a "disappointing customer experience," as its spokesman put it, but that standard depends on downstream complaints, not upstream verification. There was no requirement that the anonymous authors demonstrate any factual basis for the medical claims they were selling as biography. A provable record of what a system passed and when it was checked, before a listing went live rather than after complaints arrived, would expose that gap at the point where it can still be closed. Without it, any public disclosure of a real person's illness becomes raw material for an automated publishing run, and a platform built on reader trust becomes the distribution mechanism.

Reported impact

Affected parties
Not publicly disclosed
Harm type
Not publicly disclosed
Scale
Not publicly disclosed
Financial impact
Not publicly disclosed
Regulatory action
Not publicly disclosed

Classification

Organization
Not publicly disclosed
AI system
Not publicly disclosed
Industry
Not publicly disclosed
Country
Not publicly disclosed
Provider
Not publicly disclosed
Incident type
Not publicly disclosed

Relevant governance controls

Governance control mapping is not available for this record.

  • No controls mappedNot publicly disclosed

Control mapping is analytical. It does not state that any control would have prevented the incident.

Sources and evidence

This record was researched and written by the Index. The event is also catalogued in the following database, which is listed for cross-reference.

AIAAIC Repository
Also catalogued in
Seven AI Books Lied About King Charles' Cancer Diagnosis and Amazon Sold All of Them
2024