AI safety failure incidents
Definition
Safety failure incidents document cases where an AI system caused, contributed to, or failed to prevent physical harm, death, or serious safety risk to people, infrastructure, or critical systems.
Included
- Autonomous vehicle accidents involving AI driving or perception systems
- Medical AI errors leading to incorrect diagnosis, treatment, or dosage recommendations
- AI-controlled industrial or robotic systems causing physical harm to workers
- AI failures in safety-critical infrastructure such as aviation, energy, water, or transport
- AI systems that failed to detect or escalate dangerous conditions as designed
Excluded
- Near-misses without documented harm or credible imminent risk
- Incidents where AI played no direct safety-critical role
- Theoretical safety concerns or future risk scenarios without a documented event