In short
AI capability audits show returns and capability gaps
- An AI capability audit shows what your AI investments return and where capability is missing. Without one, leaders rely on optimistic status reports.
- A structured audit finds AI used without the organisation's knowledge, pilots waiting for a decision and governance gaps before they become incidents.
- Our working model describes how 3 types of AI leader tend to respond to audit findings. The types are Believer, Driver and Builder. Knowing your own tendency helps you act on what the audit finds.
- Set a regular audit cycle and report the results to the board. An organisation that is actively deploying AI may need a shorter cycle, such as quarterly.
Detail
The audit covers 5 areas, each answered with evidence
Many chief executives believe they know where their organisation stands on AI. An evidence-based audit can show a real gap between that belief and what is in place. That gap matters, because it shapes every investment decision that follows.
A thorough AI capability audit covers 5 areas. Each area has a small number of questions that management should be able to answer with evidence.
Strategy and governance: check that the AI strategy is documented, approved by the board and linked to business objectives. The strategy counts only if people refer to it.
Data infrastructure: find out what data the organisation holds, what condition it is in and whether it can support the AI uses being planned.
Talent and culture: confirm that the organisation has the people it needs, and that those people want the work to succeed.
Deployment and value: list the AI systems that are live, the measured return from each and the pilots that have waited months for a decision.
Vendors and technology: identify the vendors the organisation depends on and its lock-in risk. Check whether each contract protects the organisation or the vendor.
A useful audit asks for evidence. Ask to see the AI register, covering every system, every data source and every decision each system makes. Ask for actual returns compared with the original business cases. Ask what failed and why, and how concentrated the vendor risk is. Ask how each AI use meets the Privacy Act today.
The 3 types of AI leader help you act on the answers. Believers get excited by audit findings and want to accelerate everything. Drivers want to fix the gaps immediately. Builders want to design the solution properly. Each response has value, but each type can also miss something. Believers tend to skip governance, Drivers tend to skip foundations and Builders tend to move slowly.
From 10 December 2026, Australian Privacy Principle (APP) 1.7 and APP 1.8 set privacy policy disclosure rules for some automated decisions. Our article on what APP 1.7 requires sets out the test in full. An organisation that can list its AI systems and the decisions they influence will find those rules easier to meet. An audit now gives it time to prepare.
Commercial impact
Audits can find uncontrolled AI use and provider dependence
Executives who keep their AI use to themselves are a strong reason for an audit. If senior leaders will not say how they use AI, the organisation probably knows even less about use further down.
Without a structured audit, you rely on status updates from people who have an incentive to report good news. An audit can find far more active pilots than production systems. It can find staff putting company data into personal ChatGPT accounts with no controls. It can also find AI capability that depends on one provider, whose contract gives no right to move your data to another provider.
The Australian Securities and Investments Commission (ASIC) published Report 798 in October 2024. It states that directors' and officers' duties of reasonable care and diligence 'extend to the adoption, deployment and use of AI'. The duty of care and diligence for directors sits in section 180 of the Corporations Act 2001. A board that cannot show how it oversees AI capability and risk should take advice on what that duty requires of it.
The audit also shows your competitive position. A market share report shows a competitor's lead in operational AI only once that lead has changed market share. A regular audit gives you leading indicators of capability, so the board can act before the gap shows up in revenue.
In practice
Illustrative cases of audits finding data and strategy gaps
Illustrative composite: a financial services firm assessed its AI readiness and found it well behind where its chief executive expected. The gaps were in data, governance and talent. Data was spread across disconnected systems with no integration layer. There was no AI register and no board reporting, and the firm's AI specialists spent most of their time cleaning data. The firm cut its pilots back to the few that showed promise and built the data foundation first.
Illustrative composite: a mid-market manufacturer's audit found that its AI strategy was a vendor sales pitch rewritten as an internal document. It had no capability assessment, no risk framework and no link to business objectives. The strategy had to be rebuilt from an evidence-based assessment of what the business could support.
Illustrative composite: a professional services chief executive learned through an audit that competitors had been using AI proposal automation for months. The firm's win rate had fallen, and nobody had connected the fall to proposal turnaround. The audit gave the board a specific gap to cost and decide on.
What to do
Steps to run a regular audit and act on its findings
- Set a regular audit cycle for AI capability, and shorten it while you are actively deploying AI.
- Ask your team for a complete AI register that lists every system, data source, decision and measured outcome.
- Identify your own leadership tendency (Believer, Driver or Builder) and check your response to the audit against its blind spot.
- Compare your capability with what competitors are deploying, so the board sees capability in commercial terms.
- Use audit findings to stop underperforming pilots and move resources to uses with proven value.
Last reviewed
Put this topic against your own numbers, owners and timelines.