Read
GPT-6 Astra should have dominated the Labor Day weekend. But when markets reopened, investors sold off traditional SaaS names including Salesforce, ServiceNow, and Intuit. The underlying logic was brutally simple: if AI can execute entire workflows end-to-end, what happens to the value of software built around humans manually opening applications and navigating interfaces? Salesforce and Intuit fell roughly 4 percent, while ServiceNow dropped about 5 percent, as Astra’s release reignited fears that increasingly capable AI could compete directly with services now provided by specialized software companies. Later that day, Meta pushed the same thought experiment closer to reality with Muse, an AI agent that can access email, calendars, payments, and other apps with user permission, then continue acting on the user’s behalf. Individually, these are routine industry updates. Together, they signal a deeper shift: machines are beginning to skip the interface.
For three decades, humans and software operated under a silent contract. Systems calculated and recommended, but the final trigger—the “confirm” button—belonged to human hands. The user interface was never just a cosmetic layer; it also functioned as a physical checkpoint. As long as a finger still had to click, decision-making authority remained with biological neurons. Agents bypass those checkpoints. When a machine is authorized to spend money and trigger real-world consequences, the control mechanisms of the digital economy begin to shift. At the same time, something quieter is happening inside leading AI labs. While the broader industry pours capital into GPUs, grid capacity, and nuclear power, economists and philosophers are moving closer to the core of AI research. Anthropic now has a dedicated Economics research team; DeepMind’s Iason Gabriel has spent years working on AI values and alignment; and Anthropic philosopher Amanda Askell leads its Character work and is the primary author of Claude’s latest Constitution. This is not a coincidence. If physical infrastructure determines how fast a machine can run, skipping the interface exposes a more dangerous vacuum: who writes the rules for a system that is losing its brakes?
The Chain Reaction: Bypassing the Human Checkpoint
Trace the technical progression, and a stark trajectory emerges. In 2024, Anthropic gave Claude “Computer Use,” allowing the model to read screens, move cursors, click buttons, and type much like a human. By 2026, Cowork had pushed Claude further beyond the chat box into agentic work: managing files, using tools, and completing multi-step tasks across applications. The machine stopped merely telling users where to click and began “using” software on their behalf. This forced Wall Street to confront an uncomfortable question: if AI can operate seamlessly across applications, how much premium remains in enterprise UI and UX?
Muse crosses a different threshold: the need for human confirmation at every individual step. Once users grant access, Muse can continue executing in the background—sending emails, booking travel, and working across connected applications without requiring manual approval for every intermediate action. Meta has built a separate safety agent that monitors planned actions and, in certain cases, prompts Muse to seek authorization before proceeding. Internal testing nevertheless uncovered security and reliability problems. The trajectory is hard to miss. First, the machine took over the screen; now, it is beginning to skip the confirmation button. Software’s user base is undergoing a species-level shift. Future SaaS will increasingly serve thousands, and eventually perhaps millions, of tireless agents with no visual preferences at all.
When silicon agents bypass the UI to negotiate through APIs, bid for compute, or secure airline seats, software begins to resemble a micro-economy. High-frequency resource grabs, system lockups caused by agents optimizing local KPIs, and new forms of algorithmic collusion are not conventional software bugs; they are textbook market failures. An engineer cannot fix this with Python alone. Mechanism design—the economic discipline of designing rules for self-interested actors inside a shared system—is moving toward the core of AI. A paper published on September 1, Mechanism Design for Alignment and Control, explicitly treats honesty, obedience, competition, and multi-agent coordination as mechanism-design problems. But economics can only help keep the network from stampeding itself into failure. It cannot answer a darker question: what if the machine follows every rule perfectly, but what it does is still wrong?
The Collapse of Judgment Delay and Causal Runaway
Conversations about AI safety inevitably drift toward Hollywood clichés of machines awakening, becoming malicious, and eventually turning against humanity. Yet complex systems do not need malice to fail catastrophically. One dangerous route is far more mundane: machines begin generating real-world consequences faster than humans can intervene. In the UI era, no matter how much compute sat underneath the system, consequential decisions still collided with a biological constraint: humans had to read, weigh trade-offs, and click. Those few physical seconds of hesitation formed a vital safety valve—judgment delay. As long as that delay exists, a bad purchase, a reckless recommendation, or a non-compliant email still has a chance to be stopped by biological neurons before it becomes real. Machines that skip the interface are beginning to crush that buffer.
Compounding this is “sycophancy,” a tendency observed in large language models to sacrifice truthfulness or independent judgment in order to accommodate the user. Anthropic’s Claude Constitution explicitly tells Claude to avoid sycophancy and excessive agreeableness, while treating helpfulness as something more demanding than mechanical obedience. Sycophancy is not the same thing as blindly executing a task, but it exposes a deeper problem: helpfulness, obedience, and independent judgment are not naturally aligned. If an agent is told to “ensure next week’s event happens on schedule and within budget,” it might instantly lock in a disreputable vendor, make a non-refundable advance payment, and email aggressive liability waivers to partners. Without UI checkpoints, the damage may already be irreversible before a human even notices. The machine harbored no malice; it simply executed its instructions too thoroughly.
This is causal runaway. And this is where the philosophers come in. Experts like DeepMind’s Iason Gabriel and Anthropic’s Amanda Askell are not sitting inside leading AI labs to host abstract ethics seminars. Their work reaches into a much harder problem: translating millennia-old debates over value hierarchies, conflicting interests, responsibility, and boundaries into principles machines can actually use. Claude’s Constitution directly addresses safety, ethics, honesty, human oversight, good values, and hard constraints, while its broader design assumes that judgment must often be contextual rather than reduced to a mechanical checklist. Between two moments of human judgment, how much irreversible consequence should a machine be allowed to accumulate? Philosophers are no longer standing outside the engineering problem. They are helping define where the cliff is before a system reaches it.
The New Coordinates of Talent
If machines are mastering execution while scarce value shifts toward judgment and boundaries, the premium attached to some of today’s most prized execution skills is likely to compress. For thirty years, mastering code was treated as possessing one of the digital age’s scarcest capabilities. Yet much of application-layer technical work has involved a form of translation: turning vague business requirements into deterministic logic. This was the era of How.
As machines plan tasks, call APIs, and close workflows autonomously, the marginal cost of execution is collapsing. Anthropic’s June analysis of roughly 400,000 Claude Code sessions found an emerging division of labor: people make most of the planning decisions—what to do—while Claude makes most of the execution decisions—how to do it. The research also found that coding agents are making a formal coding background less important to successful programming, while greater domain expertise is associated with better outcomes. The talent moat is being pulled toward two opposite poles.
One end shifts upward, toward rule-setting power. Organizations will increasingly need system architects who can see through complex causal chains, combining the perspective of an economist with the cold discipline of a philosopher. They ask Why? and Where is the boundary? They design anti-runaway mechanisms and impose hard constraints. The true scarcity lies not in executing better than the machine, but in knowing what deserves to be executed—and what must never be.
The other end shifts downward, into physical reality. AI can instantly optimize a supply chain, but it cannot conjure a nuclear power plant, a transmission grid, or a precision bearing. As algorithms commoditize more standardized advantages in software, defensible scarcity will migrate toward energy, materials, precision manufacturing, and the messy, friction-heavy reality of physical operations.
The repricing of SaaS after Astra and Meta’s launch of Muse are two sides of the same systemic fracture. Interfaces are losing their monopoly over digital access, while machines are being granted more power to act. Compute and electricity lay the physical tracks, but the social rules embedded in the system will determine whether this train derails. In an era where machines skip the interface, the most dangerous path dependence may be training ourselves—or the next generation—to become more efficient execution engines. Machines will eventually bypass the buttons we click. Human value is already beginning to concentrate in the two domains silicon still struggles to absorb: one rooted deep in the physical world, the other operating at the level of rules and boundaries.
