行业多源确认
OpenAI、Google、Microsoft、Anthropic 承诺统一内容抓取屏蔽标准
AI giants promise publishers new way to block some scraping
精选理由
四家大厂联手搞了个统一的爬虫屏蔽标准，做内容的以后不用挨个设置 robots 规则了，跟 OpenAI 这些公司的版权纠纷直接相关。
OpenAI、Google、Microsoft 和 Anthropic 四家公司承诺为媒体网站提供单一的内容屏蔽标准，统一阻止其内容被抓取用于 AI 模型训练。目前出版商需要对每个爬虫机器人单独设置屏蔽指令，操作繁琐。此举发生在新闻出版商对 AI 公司提起多起法律诉讼、批评声不断增多的背景下。
原文 · Inquirer: Technology
AI giants promise publishers new way to block some scraping
SAN FRANCISCO — OpenAI, Google, Microsoft and Anthropic pledged Friday to give media outlets and other websites a single way to prevent their content from being scraped to train artificial intelligence (AI) models, amid growing criticism and legal battles involving news publishers. Publishers currently have to implement multiple blocking commands for every bot that crawls
