Validity and Clustering of AI Safety Incident Causality Analysis
This article identifies and addresses some shortcomings and potential objections to the original Root Cause Analysis method including reliability and epistemology of responses.
It then describes a cluster analysis of 50 incident reports aimed at identifying correlations between clusters of causes and different types of harm.
Root Cause Analysis of AI Safety Incidents
The application of Root Cause Analysis tools that are widely used in other areas of engineering could provide insights into the causes of AI safety incidents that would reduce the likelihood of recurrence and support the prioritisation of risk mitigation and harm reduction measures.
This post proposes and demonstrates an approach for using language models to process incident reports and make inferences as to potential causes.
The approach could offer a scalable methodology to aggregate causality data from historic incidents and potentially from modelled future scenarios, in order to contribute to a reduction in the numbers of future safety incidents and the severity of harm caused by them.