Abstract
In this factsheet we describe the proportion of news websites in ten countries that block AI (artificial intelligence) crawlers. We find that, (i) by the end 2023, 48% of the most widely used news websites across ten countries were blocking OpenAI’s (ChatGPT) crawlers. A smaller number, 24%, were blocking Google’s (Gemini) AI crawler. However, (ii) the proportion of news websites that blocked OpenAI varied considerably by country, ranging from 79% in the USA to just 20% in Mexico and Poland. For Google, the figures ranged from 60% in Germany to 7% in Poland and Spain. We also find that (iii) all types of news outlet were blocking, but the websites of legacy print publications were more likely to be blocking than those of either broadcasters or digital-born outlets.
Twitter Thread
How many news sites block AI crawlers from @Google and @OpenAI?
— Reuters Institute (@risj_oxford) February 22, 2024
This is the question at the heart of a new factsheet by @richrdfletcher, who looks at the 15 top news sites in 10 countries covered by our #DNR23
📱Full factsheethttps://t.co/A3RMzY2TkG
🧵5 findings in thread #AI pic.twitter.com/me8H7UpoMY