The Race to Block OpenAI’s Scraping Bots Is Slowing Down

October 7, 2024

OpenAI logo with a metallic outline of a brain

(Wired) – It’s too soon to say how the spate of deals between AI companies and publishers will shake out. OpenAI has already scored one clear win, though: Its web crawlers aren’t getting blocked by top news outlets at the rate they once were.

The generative AI boom sparked a gold rush for data—and a subsequent data-protection rush (for most news websites, anyway) in which publishers sought to block AI crawlers and prevent their work from becoming training data without consent. (Read More)