Discussion about this post

User's avatar
Alireza Rahmani Khalili's avatar

"Shadow decision-making" is the framing the governance conversation has been missing. Shadow AI as a tool problem is manageable you can audit tool usage. Shadow decision-making is structural the influence is invisible by design and doesn't show up in any dashboard until something expensive breaks.

The five diagnostic questions are the right unit of analysis. Moving from "was AI used?" to "what did AI change?" shifts governance from permission management to operational control. Those are completely different problems requiring completely different infrastructure.

I write about production AI systems and distributed backends the technical layer where these governance requirements have to actually be enforced at runtime. Worth a subscribe here too.

Fred Malherbe's avatar

Very, very important perspectives here. I hope the right people pay attention.

"The failure may appear as a hidden assumption..." -- if the road to hell is paved with good intentions, the road to organizational calamity is going to be paved with hidden assumptions.

You *assume* because the LLM says "Of course" that it understands you and is going to carry out what you intended. Then these assumptions get built into the infrastructure.

My zeroth rule in editing is "Do no harm". My first rule is "Never, ever, assume". And I don't. When I was on the newsdesk, I had all the journalists' names in my spell check. The number of reporters who spelled their name wrong was quite scary. I always pointed this out to them.

2 more comments...

No posts

Ready for more?