AI Governance: Why Boards Must Lead the Conversation

Cinzia Donalisio | Italy
Every business publication has run its version of the AI story by now. The productivity gains. The generative breakthroughs. The regulatory scramble. What's had far less airtime is the question that actually belongs to boards: not what can AI do, but who is accountable for what it does.
AI isn't a matter to leave with IT departments or data scientists. Increasingly, it's a matter of governance. And governance belongs in the boardroom.
The risks don't sit in IT
AI has already moved past the pilot stage. It's shaping pricing, hiring, credit decisions, customer experience, and competitive positioning across healthcare, financial services, manufacturing, and professional services alike. The organisations pulling ahead aren't necessarily the ones with the most advanced models. They're the ones that decided, early, whose job it is to ask hard questions about how those models are used.
Bias baked into training data doesn't stay in a data science sandbox – it surfaces in who gets a loan, an interview, or a promotion. Opaque algorithmic decisions affect real people's rights and opportunities. Generative tools can spread misinformation or leak intellectual property before anyone notices. And regulation is catching up fast.
Alongside these opportunities come new categories of risks. Algorithms can replicate or amplify the biases in their training data. Automated systems can produce opaque decisions that affect people's rights and opportunities. Generative tools can spread misinformation or compromise intellectual property without anyone intending it to. Regulation, meanwhile, is moving quickly to catch up – in Europe, the AI Act signals a new era in which organisations are expected to demonstrate transparency, accountability, and responsible use.
As opportunity travels with risk, effective governance is what bridges the two. It's a reason for boards to get closer to how AI decisions get made.
Governance is not a brake on innovation
There's a persistent myth that oversight and speed are opposites. In practice, the opposite tends to be true. Companies with clear AI governance frameworks scale faster, because they've already answered the questions that would otherwise stall a rollout.
Boards don't need to master the technology. They need to ask the questions technologists sometimes don't: Does this support our long-term strategy? What risks are we accepting, and who's monitoring them? Does management have the capability to deploy this responsibly?
Trust is the real currency
Trust is quickly becoming a defining factor in the adoption of AI. Customers, regulators, employees, and investors are converging on the same expectation: that organisations can show their work. Transparency in algorithmic decisions, accountability in automated processes, and clear ethical principles in data usage are no longer optional. They're what corporate legitimacy looks like in 2026.
The human question underneath the technical one
AI governance is ultimately a people question. Organisations need to build the skills to work alongside these systems, and leaders need to guide teams through a transformation that touches processes, decision-making models, and professional identities – not just tooling.
In all of this, the human dimension must remain central. Technology should augment human capabilities, not diminish human responsibility or judgment. A key role of leadership — and particularly of boards — is to ensure that technological progress remains aligned with human values and societal expectations.
Pope Leo XIV has made a related point in his own reflections on technological change: that innovation should never lose sight of the human person at its centre. The measure of these systems isn't how powerful they become, but whether they serve human development, dignity and social progress. Boards are well placed to hold that line, ensuring progress stays tethered to human judgment, not just capability.
For directors, this means building a new kind of fluency. Not coding skills, but the ability to ask informed questions, challenge management constructively, and know what "responsible AI oversight" actually looks like in practice.
This is where firms like Amrop increasingly work alongside boards: strengthening composition with directors who bring real technology and digital transformation experience, assessing whether a board is actually equipped to oversee AI risk, and facilitating the strategic conversations that turn good intentions into governance.
AI governance, at its core, is stewardship. Artificial Intelligence represents one of the most profound technological shifts of our time. The boards that treat it merely as a technical tool risk underestimating its strategic and societal implications. Thosethat treat it as a strategic responsibility will be the ones best placed to capture its value without losing the trust it depends on.
Five Questions Every Board Should Ask About AI
- How does AI support our long-term strategy? Ensure AI initiatives align with strategic priorities and real value creation.
- What are the key risks in how we use AI? Understand exposure across data, bias, cybersecurity, regulation, and reputation.
- Do we have the right governance framework in place? Clear principles for accountability and transparency should exist before scale, not after.
- Does the board have sufficient expertise to oversee this? That may mean recruiting directors with digital experience, or bringing in external advisors.
- How are we keeping AI human-centred? Adoption should respect ethical principles, and support employees and stakeholders — not just efficiency metrics.