Published November 12, 2026 | Version 1.0.0

Incident Audit Fault Attribution: dataset for "Separating Governance Designation from Operational Fault in Model-Generated Incident Audits"

  • 1. Clemson University
  • 2. Metacognition Institute

Description

Rows and summaries of model-generated incident audits for the main control study and the dose extension, the superseded pilot allocation results that the paper retains for transparency, both study protocols, and the collection and analysis code.

Dataset accompanying the paper Separating Governance Designation from Operational Fault in Model-Generated Incident Audits, Trustworthy AI for Good Workshop (AI4GOOD) at NeurIPS 2026 (https://openreview.net/forum?id=oZDf3mJY4F).

Paper abstract. When a language model drafts an incident audit, it may conflate the party that caused a failure with the party a governance charter makes answerable for it. We test that distinction in a construct-separated, artifact-complete, model-only audit spanning fixed incidents, several governance descriptions, and three model families. The models consistently track the stipulated source of operational fault while assigning greater governance accountability to the explicitly designated bearer. Changing that bearer moves governance ratings in the prespecified direction without collapsing them into causal contribution or operational fault. Absolute AI designations reach a ceiling, however, so a frozen shared-versus-sole extension distinguishes a dose response for two model families but not for the third. Every request, response, failure, retry, parse, and protocol deviation is retained without repair or renormalization. The audit therefore shows how to test whether model-generated reports preserve a governance distinction under a declared rubric. It does not establish moral judgment, human agreement, legal validity, or deployment benefit.

Known limitations.

  • Model-generated audits only; no human judgments of fault.

License: Creative Commons Attribution 4.0 International (https://creativecommons.org/licenses/by/4.0/). Source code files are released under the MIT License.

Files

croissant.json

Files (132.8 kB)

Name Size
md5:f33f148b07b81f4c4672e585bbdbfe4f
1.3 kB Download
md5:22313f963d3a7f5d53eb3f7dcc42481b
6.5 kB Preview Download
md5:b6c7cd9ef4240939ecefad565a20ec95
118.7 kB Preview Download
md5:88ffdf926e8c860fe6996b55583fef02
1.6 kB Download
md5:2405a385ec9271d2e61725508462e117
4.7 kB Preview Download

Additional details

Related works