Loading...

Why AI Stalls at Scale: The Operating Model Problem CIOs Can't Ignore

"The technology playbooks of the past don't work in the AI world. Those areas could tolerate more ambiguity between business and tech teams. AI doesn't tolerate the same level of ambiguity. It needs clarity."

— Afshean Talasaz, former CIO of Colonial Pipeline, now executive advisor

Here is the uncomfortable finding that should reframe every enterprise AI budget conversation in 2026: the technology is ready, and the organization is not. According to a Deloitte survey of 3,235 business and IT leaders across 24 countries, only 21% of organizations report having a mature governance model for AI agents. Meanwhile 74% of enterprises struggle to demonstrate return on their AI investments, and 83% cite data quality as their single biggest AI blocker. A recent CIO.com analysis draws the conclusion these numbers point to: the thing standing between a promising pilot and AI at scale is almost never the model. It is the operating model. This piece summarizes that argument and what leading CIOs are actually doing about it.

The Real Bottleneck Is Organizational, Not Technical

West Monroe's Dave Hilborn, who leads the firm's Organization, People and Change practice, frames the problem as a "three-arrow" model: AI capability, organizational and people readiness, and data readiness all have to advance together, but in most enterprises the technology arrow has raced far ahead of the other two. The distance between them is the readiness gap, and it is where AI initiatives quietly stall.

This reframing matters because it changes what you fund. If you believe the blocker is technical, you buy more tools, more model access, more compute. If you accept that the blocker is organizational, you invest in data foundations, governance, skills, and, above all, the way business and IT actually work together. The CIO.com analysis is blunt that most enterprises are still spending as if the first belief were true, which is precisely why so many are in the 74% that cannot show ROI. This is the same gap we explored from the technology side in our look at what it really takes to deploy autonomous AI agents in the enterprise: the agents work; the surrounding organization is what is unfinished.

The Number to Sit With

Only 21% of organizations have a mature governance model for AI agents, yet Deloitte found 74% expect to be using agents at least moderately by 2027. That gap, roughly four out of five companies scaling agents faster than they can govern them, is the single clearest signal that operating models, not algorithms, are the constraint on enterprise AI in 2026.

Why the Old IT-Business Split Breaks Under AI

For decades, enterprise technology tolerated a certain ambiguity between business and IT: the business asked for capabilities, IT delivered systems, and a fuzzy boundary in the middle was survivable. Afshean Talasaz, former CIO of Colonial Pipeline, argues that AI is different in kind because it operates precisely at the intersection where data is produced and business processes consume it. When a model makes decisions inside a live process, an unclear handoff between the team that owns the data and the team that owns the outcome is no longer a nuisance; it is a source of real business risk.

Forrester VP and principal analyst Boris Evelson adds the sponsorship dimension: "Enterprise data, analytics, and AI programs succeed when business CxOs sponsor them because they are accountable for business outcomes, not just technology delivery." The anti-pattern is the IT-led AI initiative that becomes siloed and tool-focused, chasing a portfolio of disconnected use cases rather than a business capability. Escaping what the analysis calls the "use case trap" requires treating AI as a sustained, business-sponsored program, not a series of IT experiments.

Redesign the Process, Don't Bolt AI Onto It

Evelson draws the sharpest practical distinction in the piece: organizations can either incrementally enhance existing workflows by augmenting them with AI, or they can redesign the process end-to-end. The companies actually capturing value are doing the latter. Bolting a copilot onto a broken process gives you a faster broken process; the returns come from rewiring the work itself with AI at the core.

Levi Strauss is the standout example. Operating across 100 countries and more than 3,000 stores, the company built a single source of truth underpinned by more than 1,100 standard operating procedures governing how work happens on SAP. Those documented procedures became, in the company's words, "fertile material to feed to LLMs on how work gets done." The concrete result: partner EDI onboarding that used to take three to six months now takes days. That outcome did not come from a better model; it came from having the process documented and the data foundation clean enough for AI to act on. It is the same principle behind why you cannot simply vibe-code an ERP: structured, governed process data is what makes AI useful on serious enterprise work.

Build the Data Foundation, and Split the Budget Accordingly

If 83% of organizations name data quality as their top blocker, the data foundation is not a prerequisite to get past quickly; it is a large share of the actual work. Forrester's guidance, cited in the analysis, is to allocate roughly 48% of AI spending to foundational elements, data management and engineering, and about 52% to consumption, meaning analytics, governance, and applications. In other words, nearly half the budget should go to plumbing that never appears in a demo.

Chase Christensen, segment CIO at contract manufacturer Jabil, describes the governance challenge at scale vividly: the company had to "put tech in place so consumption is easier, and drive ownership around data and decision rights, so 140,000 employees don't feel empowered to create their own data sources that fall out of line." Jabil built five-plus years of predictive analytics before layering generative AI on top, starting narrow with computer vision for product quality and expanding into more complex scenarios, and has been able to scale revenue while holding SG&A flat through AI-enhanced processes. The data discipline that makes this possible is the same foundation that clean core and S/4HANA AI readiness demand: AI only compounds on top of governed, trustworthy data.

Embed Governance in Workflows, Not in Committees

The most actionable shift in the analysis is about how governance is implemented. Governance as a separate committee that reviews requests slows innovation to the point of irrelevance. Governance embedded into the workflow, by contrast, makes compliance close to automatic. In practice that means peer review built into the development process, bias checks that run before deployment, and clear escalation paths for high-risk use cases, rather than a policy document nobody reads.

Levi Strauss operationalized this with an agent registry: a living record that tracks every deployed agent, who authored it, and who is accountable for it. As agentic AI proliferates, this kind of registry becomes essential infrastructure, because, as Lopez Research founder Maribel Lopez notes, "non-human identity and access control is totally different and, frankly, evolving so quickly that no one knows what to do." Evelson captures the tightrope precisely: push agentic capabilities too far and you create a compliance nightmare; tighten controls too aggressively and you strangle innovation. The balance is still being discovered, which is exactly why it belongs in the operating model rather than in a static policy. We covered the underlying risk categories in our guide to the generative AI risks enterprises actually need to manage.

Two Kinds of AI, Two Kinds of Governance

Talasaz separates AI into two governance categories. Desktop or general AI, the productivity tools employees use day to day, needs literacy programs and guardrails, what he calls "bumpers." Integrated or industrial AI, embedded in core business processes, needs business leaders who deeply understand both the benefits and the risks, because they own the outcomes those processes produce. Applying one governance model to both is a common and expensive mistake.

Design Different Operating Models for Different Speeds

There is no single correct operating model, and treating one as universal is itself a failure mode. Talasaz puts it directly: "A business that needs to build capabilities in a marketplace moving very fast requires one kind of operating model. A business that can take longer to develop business capabilities and adapt to market changes can choose a different operating model." The operating model should be tailored to the speed and stakes of the business it serves.

This applies with particular force to the gap between proof-of-concept and production. The lightweight, exploratory operating model that lets a team prototype quickly is the wrong model for running AI reliably at scale, which needs clear standards, defined roles, explicit skills requirements, and repeatable processes that get cheaper as the organization learns. Using the POC operating model in production is one of the most common reasons promising pilots never scale. The broader arc, from scattered experiments toward a coherent, AI-native way of operating, is the subject of our roadmap to the autonomous enterprise.

It Has to Start at the Top

Every thread in the analysis converges on leadership. The skills and culture work, AI literacy programs that demystify the technology and reduce the fear that Jabil's Christensen saw firsthand ("fear about jobs, not knowing what AI did"), cannot be delegated to a training vendor. Nor can the harder task of articulating what a reinvented business actually looks like so that teams have the direction to build toward it.

Jason Gowans, chief digital and technology officer at Levi Strauss, states the requirement plainly: "When you're committed to upskilling the workforce, you're better served to answer how to rewire processes with AI at the core. It starts at the top. It has to be an exec priority." Deloitte's data backs him up: enterprises where senior leadership actively shapes AI governance capture significantly more business value than those that hand the work to technical teams alone. The operating model is, in the end, a leadership artifact.

The Practical Takeaway for Leaders

If you strip the analysis down to a checklist, five moves distinguish the organizations pulling ahead. Make the IT-business partnership explicit and jointly accountable for outcomes, not just delivery. Redesign the highest-value processes end-to-end rather than bolting AI onto them. Fund the data foundation like it is half the work, because it is. Embed governance into workflows, with an agent registry as living infrastructure, instead of routing everything through a committee. And design the operating model deliberately for the speed your business actually needs, with different models for exploration and for scale.

None of this is a technology purchase, which is exactly why it is hard and why it is where the advantage now lives. The models are largely commoditized and, as we noted in our analysis of businesses switching to cheaper AI models, getting cheaper every quarter. The durable differentiator in 2026 is not which model you run. It is whether your operating model can actually put it to work.

Share This Article