This article mentions an LLM that had 45% of it's content taken from websites in violation of the longstanding Robots Exclusion Protocol (familiarly, robots.txt). We shouldn't have trusted AI firms with our current opt-out method… and now they want a new one? www.nytimes.com/2024/07/19/t...

The Data That Powers A.I. Is Disappearing Fast

New research from the Data Provenance Initiative has found a dramatic drop in content made available to the collections used to build artificial intelligence.

This is chilling.