Does Google still follow robots.txt? I think so. Should be easy to exclude Google Crawlers if that's what you're after. But of course everyone wants to profit off of Google's reach so excluding them won't work for most either.
We've had ~20+ years to come up with something better than copyright with nothing to show for. First it was the plebs ignoring copyrights, then it was the search engines and social networks and their knowledge graphs and now it's the billionaires and their AI companies that hoover up the web.
We've had ~20+ years to come up with something better than copyright with nothing to show for. First it was the plebs ignoring copyrights, then it was the search engines and social networks and their knowledge graphs and now it's the billionaires and their AI companies that hoover up the web.