
The Agent Reckoning: Why 2026 Is the Year Enterprises Discover They Shipped Too Fast
Connecting the dots nobody wants to connect
Read the enterprise headlines from this week back to back and a very ugly pattern emerges. Fifty-four percent of enterprises have already had an AI agent security incident. Half have shipped an agent that passed internal evals and then face-planted in front of a real customer. Most orgs can't measure what their AI compute actually costs. And a majority have watched their RAG-fed agents produce confident, wrong answers.
Four separate surveys. One story. We are deploying autonomy faster than we can govern it.
I've lived through a few of these cycles — the mobile land grab, the cloud migration scramble, the microservices religion. Every one of them followed the same arc: exciting capability lands, everyone ships to look modern, and then eighteen months later the bill comes due in incidents, cost overruns, and rewrites. The AI agent wave is running that exact playbook, just faster and with production credentials attached.
The scariest number isn't the incident rate
Everyone's going to fixate on "54% had an agent incident." That's bad, sure. But the number that actually keeps me up is that most agents still share credentials and only a third get scoped identities. We spent two decades in security teaching engineers about least privilege, service accounts, and zero trust. And then we handed a non-deterministic language model the shared admin key because the demo looked great.
I saw a version of this early in my career on an enterprise product. A well-meaning team wired a background service to a broad set of permissions "temporarily" to unblock a launch. That temporary grant lived in production for three years. When we finally audited it, it had access to customer data three teams didn't even know existed. Now imagine that same shortcut, but the thing holding the credentials makes its own decisions and can be prompt-injected. That's where a lot of orgs are right now, and most don't know it.
Evaluation is the new integration testing — and it's failing
The eval survey is the one that should reframe how every TPM thinks about "done." Only one in twenty enterprises fully trusts their automated evaluation. The most-cited weakness? Evals don't align with real-world outcomes. Half shipped an agent that passed the internal gate and still failed the customer.
Here's the uncomfortable translation: your green dashboard is lying to you. We built our whole release discipline around deterministic tests — same input, same output, pass or fail. Agents don't work that way. They're probabilistic, context-dependent, and drift with model updates. Passing a static eval suite tells you almost nothing about how the agent behaves on the messy edge cases real users bring.
This is a program management problem, not just an ML problem. The teams treating eval like a checkbox before launch are going to keep shipping things that pass and then fail. The teams treating eval as a continuous, production-anchored loop — sampling real interactions, scoring them against outcomes, feeding failures back — are the ones who'll actually build trust.
The cost gap is the silent killer
Then there's the compute survey: spending is accelerating faster than anyone's ability to measure it, and the next dollar is aimed at specialized hardware almost nobody uses yet. Most orgs plan to switch or add providers within the year.
Connect that to China. Moonshot and Alibaba are shipping models they claim match OpenAI and Anthropic at a fraction of the cost, and Jensen Huang is out cutting hardware deals across entire national ecosystems. The frontier lead is compressing, and price is becoming the battlefield. What that means for enterprises: the model you standardized on this quarter may be economically obsolete next quarter. If you've architected yourself into a single provider with no cost observability and no swap path, you're exposed on both ends — you can't see what you're spending and you can't move to something cheaper.
The winners of the next phase won't be the teams with the smartest agents. They'll be the teams that can measure, secure, evaluate, and swap them without a rewrite.
What about the culture war stuff?
The Nolan "Trojan horse" quote, Dave Eggers telling OpenAI staff ChatGPT is "silencing a generation," YouTube cracking down on AI slop, the Suno music debate — it's easy to file these under noise. Don't. They're a leading indicator of the trust and legitimacy fight coming for every AI product. YouTube demonetizing slop is the platform market pricing in quality signals. The MIT hiring-bias research is the regulatory and reputational risk arriving. Together they signal that "we used AI" is no longer a bragging right — it's a liability you have to justify. TPMs should be planning for provenance, disclosure, and quality gates as first-class product requirements, not afterthoughts.
What TPMs should be preparing for
- Agent identity and least privilege as a launch blocker. No agent ships to production sharing credentials. Every agent gets a scoped identity. Treat it like you'd treat a new microservice's service account.
- Continuous, outcome-anchored evaluation. Static eval suites are necessary but insufficient. Budget for production sampling and human-in-the-loop scoring.
- Cost observability before you scale spend. If you can't attribute AI spend to a feature and a team, you can't govern it. Instrument first.
- Provider portability. Abstract your model layer. Assume you'll swap providers within a year, because the survey data says you will.
- Blast-radius thinking. Isolate your highest-risk agents. Only 30% of enterprises do this today — be in that 30%.
Related: see Ford Rehired the Gray Beards. That's the AI Story of 2026. and TPMs, Stop Drowning in Busywork: How AI Agents Are Reshaping Our Workflows Today.
What I'm doing about this right now
Concretely, on my own teams:
- Running a "credential audit" on every agent-adjacent workflow. Any shared credential gets flagged and a scoped-identity migration goes on the roadmap. This is boring, unglamorous work and it's the single highest-ROI thing you can do this quarter.
- Building a production replay eval. Instead of trusting a static test set, I'm pushing the team to capture anonymized real interactions and score agent behavior against actual downstream outcomes. If it passed the gate but the customer bounced, that's a failure we log and learn from.
- Adding a cost-per-outcome metric to our dashboards. Not cost per token — cost per completed user task. That's the number that survives a provider price war.
- Prototyping a model abstraction layer so we can A/B a cheaper model (including the new open-weight options) against our incumbent without a rewrite. I'd rather have the swap muscle before I need it.
The capability is real and it's here to stay. But we've been here before with every major platform shift, and the lesson never changes: the teams that pair ambition with governance win, and the teams that ship first and govern later spend the next two years cleaning up. Pick your side now.
Follow along
Get new posts as they publish, in whichever format you read.


