How Are You Measuring AI Adoption?

How are you measuring your enterprise AI adoption right now? Is it percentage of logins, token consumption, seats activated across departments?

If that’s the core of your reporting, you’re merely scratching the surface.

I hear the same thing from executives constantly: “We deployed the tools, adoption looks healthy, but I’m not seeing the ROI.” The dashboards are green, the business case is still fuzzy, and the next budget conversation is approaching fast.

The problem is that most organizations are tracking activity and calling it value. Its like measuring whether people showed up to the gym rather than whether anyone actually got healthier.

If your AI adoption reporting stops at logins or token counts, you’re tracking activity, not impact.

AI ROI lives on three tiers, and each one answers a fundamentally different question

I’ve been working through this with enterprise clients for the past year and I keep coming back to a framework that separates signal from noise.

1\ Tier 1 is activity (leading indicators). Daily active users, queries per person, agent actions by department. This tells you whether people are using the tools, and this is where most enterprise reporting stops. High adoption with no efficiency signal just means people are logging in without necessarily getting value from it. If you measure AI adoption this way, people will log-in to check the box, and get nothing real out of your AI investments.

2\ Tier 2 is efficiency (lagging indicators). Hours saved per employee per week, ticket resolution time, internal support deflection rate, time-to-answer on knowledge queries. For example, consider data showing customers saving 2 to 3 hours per employee per week with a 20% reduction in internal support requests. When you run that across ten thousand knowledge workers at $75/hour fully loaded, you get to $97.5 million annualized, which is the kind of number that reframes a budget conversation entirely.

3\ Tier 3 is business outcomes (strategic indicators). Revenue influenced by AI-assisted processes, customer satisfaction scores, employee retention, time-to-productivity for new hires, cost avoidance. This is where ROI becomes a strategic conversation rather than a procurement justification, and it’s the tier where measurement requires the most organizational commitment.

The finding that should make everyone pause

Deloitte’s 2026 survey of 3,235 leaders found 66% reporting productivity gains from AI but only 20% seeing actual revenue growth. On the surface that looks like AI delivers efficiency but not top-line impact. But I think the more honest read is this: how many of those 66% actually measured a pre-deployment baseline and compared it against post-deployment Tier 2 and Tier 3 metrics? Or are they reporting that the tools “feel productive”, that employees say they’re helpful, that the activity dashboards look strong, and calling that a productivity gain?

There’s a meaningful difference between “our employees report feeling more productive” and “we measured that ticket resolution dropped from 4.2 hours to 2.6 hours in the six months following deployment, controlling for volume changes.”

The former is Tier 1 sentiment dressed up as Tier 2 evidence. The latter is actual measurement. My suspicion is that a significant portion of that 66% is closer to the first category than the second, which means the real efficiency picture is both less clear and potentially more positive than the headline number suggests, because the organizations doing rigorous measurement consistently report stronger returns.

Why everyone defaults to Tier 1 and why moving beyond it takes real work

There’s a reason organizations get stuck measuring logins and token usage, and it has nothing to do with laziness. Tier 1 metrics are the only ones that come free. Every AI platform ships with an activity dashboard out of the box. You deploy the tool on Monday and by Friday you have a chart that goes up and to the right, and it feels like progress because it looks like progress.

Moving to Tier 2 and Tier 3 is genuinely hard. It requires defining what success means for each executive sponsor before the tool goes live, which means getting the CFO, the CHRO, and the COO to articulate their version of value in specific, measurable terms before anyone has seen a demo. It requires capturing baselines with real precision: how long does an IT ticket take today, how many hours does onboarding actually consume, what’s the average time before a new hire produces meaningful output. That baseline work serious effort, and it has to happen before deployment because you cannot reconstruct the before-state after the fact.

Most teams skip it. They’re under pressure to ship, the vendor is pushing for go-live, and spending two weeks instrumenting current workflows feels like a delay when leadership wants to see AI in production. I understand the pressure. But without that baseline work, every ROI conversation six months later becomes a debate about feelings rather than a discussion grounded in evidence. You end up with anecdotes competing against spreadsheet projections, and that’s a conversation nobody wins.

This isn’t a simple checklist exercise. It takes organizational coordination, executive alignment on what value means, and the discipline to slow down slightly at the front end so you can accelerate credibly later. The organizations that do this work build institutional confidence in AI investment that compounds over multiple budget cycles.

Speak the sponsor’s language, not the vendor’s

The other move that matters: translate your findings into the language each executive sponsor already thinks in. “Queries per user increased 34%” is a metric that lives comfortably inside a vendor’s renewal deck but produces nothing more than polite nods in a boardroom. “AI reduced new-hire ramp time by 40%, saving $12 million in first-year productivity costs” uses the same underlying data but lands completely differently because it connects to something the board already cares about.

The CFO thinks in cost avoidance and productivity recovery. The CHRO thinks in retention and time-to-productivity. The COO thinks in throughput and error reduction. Your measurement plan needs to speak all of those dialects, and defining the output language deserves as much attention as defining the input metrics.

Where this is heading

I wrote about this in The Intelligence Infrastructure: as intelligence becomes infrastructure, isolating its ROI starts to feel like asking “what’s the ROI of email?” circa 1998. Eventually email became the substrate everything ran on and the question stopped making sense. We will approach that inflection with AI, but until we arrive there, boards still need discrete justification, and the three-tier framework gives you an architecture to make the case.

The work of getting from Tier 1 reporting to Tier 2 and Tier 3 evidence isn’t glamorous and it isn’t quick. It requires pre-deployment discipline that most organizations don’t build into their timelines. But it’s the difference between defending your AI budget with conviction and defending it with hope, and I’ve yet to see a board that finds hope persuasive for more than one cycle.

Until next time,

Ram

— 

Ram Srinivasan

MIT Alum | Author, The Conscious Machine | Global Future of Work and AI Adoption Leader published in Business Insider, Fortune, Harvard Business Review, MIT Executive Viewpoints and more.

—

A Message From Ram:

My mission is to illuminate the path toward humanity's exponential future. If you're a leader, innovator, or changemaker passionate about leveraging breakthrough technologies to create unprecedented positive impact, you're in the right place. If you know others who share this vision, please share these insights. Together, we can accelerate the trajectory of human progress.

Disclaimer:

Ram Srinivasan currently serves as an Innovation Strategist and Transformation Leader, authoring groundbreaking works including "The Conscious Machine" and the upcoming "The Exponential Human."

All views expressed on "Substrate" and across all digital channels and social media platforms are strictly personal opinions and do not represent the official positions of any organizations or entities I am affiliated with, past or present. The content shared is for informational and inspirational purposes only. These perspectives are my own and should not be construed as professional, legal, financial, technical, or strategic advice. Any decisions made based on this information are solely the responsibility of the reader.

While I strive to ensure accuracy and timeliness in all communications, the rapid pace of technological change means that some information may become outdated. I encourage readers to conduct their own due diligence and seek appropriate professional advice for their specific circumstances.