📅 Oct 31, 2026
OpenAI, Google, Microsoft and Anthropic pledged Friday to give publishers a single way to block AI training scraping.
LexxWire
The plan replaces separate opt-out rules for every company's crawlers with one shared instruction.
LexxWire
A policy token in a site's robots.txt file tells AI crawlers not to use its content for training.
LexxWire
Anthropic has already started, Microsoft starts February 1, 2027, Google follows in 2027, and OpenAI in the coming months.
LexxWire
It covers future training only, scraping stays allowed by default, and opting out may cut visibility in AI apps.
LexxWire
Thanks for reading!