Not long ago, AI-generated content was a parlor trick — six-fingered popes and uncanny Tom Cruise lookalikes, more amusing than alarming. That era is over. The Iran conflict proved it: synthetic footage of detained American soldiers, Iranian fighter jets screaming out of underground bunkers, decimated radar installations, all fabricated, all viral, all widely believed, reaching hundreds of millions before anyone could verify a single frame.
The internet we once knew no longer exists. Where seeing once informed belief, it now prompts suspicion. We are living through a crisis of trust. And it extends far beyond what we can see with our eyes.
Brian Trunzo is the chief growth officer at Succinct Labs.
The intuitive response is to build better detectors; AI trained to catch AI. It doesn't work. Anyone can break the world’s leading image detectors by adding basic blur and distortion, dropping their accuracy to as low as 4%. Detection fails for the same structural reason antivirus software never eliminated malware: the attacker always has the asymmetric advantage.
But detection's failure is almost beside the point, because the problem has already outgrown it.
AI is no longer just generating content. It is acting. Autonomous agents are browsing the web, making purchases, publishing content, negotiating with other agents and interacting with humans, and in some cases children, who may have no idea they're talking to a machine. And when these agents operate at scale, the failure modes are catastrophic.
An agent trained on subtly poisoned data makes small, plausible errors in medical billing that compound across a hospital network into millions of dollars in fraudulent charges. A fleet of commerce agents, optimizing for margin, systematically exploits pricing vulnerabilities their operators never intended and cannot explain resulting in billions in losses.
A butterfly that flaps its wings in a training dataset causes a tornado in the real economy.
When the damage is done, there is no receipt. An agent’s reasoning is not a chronological trace. It’s a single pass through billions of opaque parameters and its outputs are probabilistic. Ask the same question twice and you will get slightly different answers. There is no way to reconstruct a decision that builds on endlessly changing variables. No way to audit what the agent was trained on, what instructions it followed, or why it did what it did.
A recent Stanford report identifies the core tension plainly: the defining challenge of this era is the gap between what AI can do and what society is prepared to govern. Regulation sits at the center of this challenge, and it is a morass: a surge of federal frameworks now spanning 90+ recommendations, paired with an explosion of state-level activity, where more than 1,000 bills were introduced in 2025 alone. Yet the frameworks being written are designed for a world of chatbots, not a world of agents that buy, sell, publish, consult, convince and decide.
Content labels won't help and disclosures are not enough. Once an autonomous agent acts, the damage is already done. This is a verification problem.
Proof, in this context, is cryptographic and independently verifiable. Not a claim, not a disclosure, not a watermark. An unalterable guarantee that an AI system did what it claims to have done, with the inputs it claims to have used, producing the outputs it claims to have produced – without ever revealing the underlying data.
Source
This article is syndicated for educational reading. For the latest updates, visit the original publisher.
Read on coindesk.com
