Websites are closing their doors to AI agents

Agent developers are running into a wall: websites are increasingly refusing to let autonomous AI agents act on them. Users of Meta's Muse, xAI's Grok, OpenAI's Dots and Instinct have reported in recent weeks that blocks stopped their agents from carrying out tasks on major sites. The products are pitched as a way to hand off chores such as booking a dinner reservation, clearing an inbox or shopping, but that depends on the destination site cooperating.
Two concrete cases have surfaced. Yelp told TechCrunch it permits AI agents only if they pay for its data licensing program, turning access into a commercial arrangement rather than an open one. Delta Air Lines is blocking agents from booking tickets, according to the report.
This suggests a widening gap between what agent vendors advertise and what the open web will actually allow. In practice, an agent has to impersonate a browser session to click through a site, and site operators can detect and throttle that traffic, or simply require a paid agreement. A likely trade-off for product teams is that agent reliability becomes a function of commercial deals with each site rather than of model quality, which fragments coverage across a long tail of destinations.
Why it matters: Teams building or buying agent features should assume site-level access is contested and may need licensing deals, fallback paths or user-facing notices when a task cannot complete. The economics of data licensing could also push smaller agent startups toward partnerships they can afford, in my reading, concentrating practical coverage among larger players.
Based on reporting from the original publisher. Visit the source for full context and later updates.
Publisher excerpt
Autonomous agents are the hottest thing in AI. OpenAI, Meta, Google, Instinct, and others promise their agents can scour the internet on your behalf, doing anything from booking a dinner reservation and cleaning out your inbox to buying new shoes. But what happens when the rest of the internet won't play nice? In recent weeks, […]