5/27/2015
•
EN
The googlebot monopoly
Explores how websites blocking non-Google crawlers in robots.txt files can harm web archives and create a search engine monopoly.
