Archos Labs
Data as a Decision Infrastructure

Why AI ROI Measurement Fails Without a Baseline

Rob Angeles4 min readPublished
Share
An article about AI ROI measurement discipline and why most companies fail to see returns from AI investments by Rob Angeles.

AI ROI measurement fails most companies not because AI underperforms, but because no one defined what success looked like before spending started.

Sixty-eight percent of CEOs say they have embedded AI in at least one significant business area. Fifty-six percent of those same CEOs report no revenue increase and no cost reduction from those investments. That gap is not a technology problem. It is an accounting problem.

The AI ROI measurement gap nobody admits

When a company launches an AI initiative without recording the current state of the process it is trying to improve, it has made a specific choice. It has chosen to make the results unjudgeable. No baseline means no comparison. No comparison means every outcome, good or bad, becomes a matter of opinion rather than evidence.

PwC's 29th Global CEO Survey covered 4,454 business leaders across 95 countries. Only 12% achieved both revenue growth and cost savings from AI. The rest either saw partial gains or nothing at all. I suspect the 12% are not using better models or fancier infrastructure. They probably just wrote down what "better" meant before they started spending.

What gets measured looks different from what gets funded

Most AI budgets get approved on vision. A vendor demo shows something impressive. A competitor announces an AI initiative. The board asks what the company's AI strategy is. Money moves. What rarely accompanies that money is a simple document stating: here is the metric we are tracking, here is where it stands today, here is where we need it to be in six months, and here is how often we will check.

This is not sophisticated work. A CFO would never approve a new manufacturing line without knowing current throughput and target throughput. AI investments get a pass on this basic discipline because the technology feels novel and the pressure to act feels urgent. The novelty is wearing off. The urgency is not producing results.

When speed seems more important than rigor

The strongest case against requiring measurement discipline upfront is that it slows you down. AI value can be emergent, and some of the best use cases only become visible after deployment. Demanding predefined KPIs before any money moves sounds like bureaucracy dressed as strategy.

This argument sounds reasonable until you look at the aggregate data. Companies did move fast. They deployed broadly. And 56% of CEOs have nothing to show for it. If speed without measurement produced emergent breakthroughs at any meaningful rate, the numbers would look different. The failure pattern across nearly half of all AI initiatives is not "we measured the wrong thing." Nobody established what they were measuring in the first place. Without a baseline, genuine AI-driven improvement looks identical to normal business variance. Speed without measurement does not create emergent value. It creates expensive ambiguity.

AI baseline metrics are the price of continued investment

The companies in that 12% achieving real returns did something specific. They identified targeted KPIs that enabled a disciplined, financially grounded approach to AI deployment. They treated AI like any other capital allocation decision, not like a special category exempt from normal accountability.

For any executive facing board questions about AI spend, the corrective action is unglamorous. Before approving additional investment in any AI initiative, require a written statement of the baseline metric and the targeted outcome, paired with a fixed cadence for reviewing progress. If the team running the initiative cannot produce that document, the initiative is not ready for more funding. This is not a new idea. It is the same discipline applied to every other investment category. AI does not deserve an exemption, and the data from 4,454 CEOs confirms what happens when it gets one.

Fifty-six percent of companies learned this the expensive way. The remaining question is whether your next budget cycle will add to that number or subtract from it.

Share
Rob Angeles

Written by

Rob Angeles

Most consulting engagements split the thinking from the doing. Rob doesn't. Principal Consultant at Archos Labs, he owns the full stack — assessment, architecture, delivery — across retail, financial services, healthcare, and government.