Accountability When AI Influences Decisions
One of the questions I keep returning to, both in my legal, HR, and compliance work and in my coursework at LSE, is what accountability actually means when AI influences a decision that affects a person.
The easy answer is that the human remains accountable. The model is just a tool. The lawyer, HR director, manager, or compliance lead makes the decision. The human signs off.
That answer is comforting, but it does not fully survive contact with how these systems are actually used.
When an AI tool drafts a contract clause, screens a candidate, summarizes a policy, or flags a compliance issue, it is not neutral. It shapes what the human sees. It narrows what they consider. It influences what they are likely to conclude. The human may still make the final call. But the decision has been meaningfully shaped by a system they did not build, cannot fully inspect, and may not be able to reproduce later.
That does not mean we should avoid AI. We rely on complex tools all the time. But it does mean the governance model has to change to account for that influence.
A few principles keep surfacing:
Accountability has to follow influence, not just authorship.
If AI materially shaped the decision, the governance structure has to account for that, even when a human formally made the call. Otherwise, "human in the loop" becomes more of a liability shield than a meaningful control.
Explainability cannot be bolted on at the end.
If no one can explain why the system produced a given output, no one can meaningfully review it. Explainability has to be designed into the workflow, not reconstructed after a challenge, complaint, audit, or regulator inquiry.
Documentation is a critical audit trail.
What was the prompt? What context was provided? What model or system version was used? What did the human accept, reject, or change before acting?
Without that record, an organization may know that a human approved the decision, but not how the decision was actually formed.
The hardest cases are not always the obvious ones.
Everyone understands that AI should not make termination decisions unsupervised. The more difficult questions are the dozens of smaller AI-influenced choices that shape a process over time. Each one may be defensible in isolation. Cumulatively, they may become something else.
I do not think legal, HR, and compliance teams have settled answers here yet. Many frameworks are either too restrictive to be operationally useful or too permissive to be defensible.
The real work is in the middle: building controls that are practical enough to be used, but strong enough to hold up when the decision is later questioned.
If you are working through this inside your own organization, I would be interested to compare notes on what is actually holding up in practice.



