Google, Microsoft, OpenAI and Anthropic Back One robots.txt Line to Opt Out of AI Training
Four of the biggest names in AI agreed on October 30 to read the same two lines in a website’s robots.txt file as a “no” to AI training. Google, Microsoft, OpenAI and Anthropic each said they will honor a single shared policy token, __usage_ai-training, so a site owner can state the preference once instead of writing a separate rule for every lab. The Verge first reported the deal, and TechRadar picked up the story this week as publishers started asking what it actually does. ...