In short
Board AI reporting should show what the investment returns
- Boards should accept only AI reporting that shows what the investment returns.
- The Board AI Risk Register and the Impact Loop produce 4 metric categories: value creation, risk exposure, capability maturity and competitive position.
- The Impact Loop links every AI metric to profit and loss (P&L). Drop any metric that does not connect to margin, revenue or risk.
- Boards should be able to show active AI oversight. Defined KPIs with trend lines are better evidence than an assurance that AI is being monitored.
Detail
Oversight metrics fall into 4 categories
Many board AI updates report activity: pilots launched, staff trained and vendors engaged. That is useful context, but oversight needs measures of results.
The Board AI Risk Register records each AI risk, its owner and its controls. With the Impact Loop, it produces 4 categories of metrics.
Value creation metrics cover revenue from AI-driven initiatives and cost savings from AI automation, verified against a baseline. They also cover margin improvement and shorter time to market for AI-enabled products or services. Report these in dollars each quarter, with trend lines.
Risk exposure metrics cover the number of AI systems processing personal data and the share of high-risk deployments with documented controls. They also cover data incidents or near misses involving AI, and vendor concentration, which is reliance on one or a few vendors. Another measure is whether each AI deployment has been reviewed against the Privacy Act.
Capability maturity metrics cover your stage on the AI Adoption Ladder and the rate at which pilots reach production. They also cover AI literacy across leadership and key roles, and the AI talent hired, retained or lost in the quarter.
Competitive position metrics cover intelligence on competitors' AI deployments and market share movement in segments that AI affects. They also compare customer satisfaction where AI is deployed with satisfaction where it is not.
The Impact Loop connects every metric to the P&L. For each AI initiative, it tracks 4 elements: investment in, value out, risk generated and the reinvestment decision. Keep in the board pack only the metrics that connect to one of these elements. Directors need information they can make decisions on.
Keep the board AI dashboard to a single page, with 4 sections that match the 4 categories. Rate each metric green, amber or red, and add an arrow showing its direction. Add one section for items requiring board attention. It lists anything that has moved from green to amber, or from amber to red, since the last meeting.
Commercial impact
Board oversight of AI requires measurement
Board oversight requires measurement. Anecdotes about AI progress are a weak basis for meeting the duty of care and diligence under section 180 of the Corporations Act 2001.
The Australian Securities and Investments Commission (ASIC) published Report 798 in October 2024. It states that directors' and officers' duties of reasonable care and diligence 'extend to the adoption, deployment and use of AI'. If a regulator asks your board about AI oversight, quarterly updates are better than nothing. A board that tracks defined KPIs for value, risk, capability and competitive position, with quarterly trends, has a much stronger answer.
The measurement gap is also a commercial problem. The Human Technology Institute is part of the University of Technology Sydney (UTS). A 2025 survey of 419 Australian corporate leaders by the UTS Human Technology Institute found only about 15% felt confident in their organisation's AI governance. The same survey found 21.7% of organisations said they periodically or continuously monitor the performance of their AI systems. The board's oversight depends on that monitoring. When a board asks for measurement, management has to connect AI activity to business outcomes.
Risk metrics matter just as much. Without them, boards learn about AI problems after they become incidents. The share of AI deployments with documented risk assessments is one simple measure. It flags unreviewed systems before they cause a compliance breach. Leading indicators let the board act before an incident occurs.
The Impact Loop also keeps investment discipline intact. When every AI initiative tracks investment against value each quarter, underperforming projects surface early. The board can then move capital from failing initiatives to proven ones. Without this discipline, the organisation builds a portfolio of AI investments that it cannot compare.
Directors can expect to be asked how AI risk is overseen. A board that can point to defined and tracked AI risk metrics, with trends, is in a stronger position than one relying on management assurances.
In practice
Illustrative cases of metrics that prompt board decisions
Illustrative composite: a large retailer's board adopts a 4-category dashboard. Once vendor costs and internal support time are allocated properly, 2 AI initiatives show a negative return. The board can then decide whether to move that budget to initiatives with a clear return.
The same dashboard flags vendor concentration, because most of the retailer's AI capability comes from one provider. The board sets a target to reduce that dependence, which also limits its exposure if the vendor raises its prices.
Illustrative composite: a mid-market manufacturer tracks the rate at which its pilots reach production. The rate is low, and an investigation finds the bottleneck: the IT infrastructure cannot support AI workloads at production scale. The board weighs a targeted infrastructure investment against stopping further pilots.
Illustrative composite: a financial services board tracks the AI systems that process personal data without a documented Privacy Act review. The measure shows which systems need a review first, and the board sets a date for the count to reach zero.
Illustrative composite: a board with no AI metrics finds that its AI program has run for more than a year with significant spend. No effect on profit and loss is documented. Executives give different estimates of the return in the same meeting. The board pauses new AI spending until it has metrics it can compare.
What to do
Steps to set up a single-page board AI dashboard
- Introduce a single-page board AI dashboard covering value creation, risk exposure, capability maturity and competitive position.
- Ask for metrics connected to profit and loss through the Impact Loop: investment in, value out, risk generated and the reinvestment decision. Remove everything else.
- Track vendor concentration, Privacy Act review status and the rate at which pilots reach production as early warning signs.
- Review AI metrics each quarter with trend lines and green, amber or red ratings. Flag anything that moves from green to amber for board attention.
- Use competitive position metrics to guide investment. If competitors deploy AI in areas you have yet to cover, treat that as a strategic risk.
Last reviewed
Put this topic against your own numbers, owners and timelines.