Semi related question (I promise this won’t be every interaction on here we have I don’t wanna be that annoying), how do you answer AI folks who are like “if we run out of data it’s fine, we can just use the data we have and feed itself with it and it’ll be even better” or what have you?

some claim that synthetic data is a solved problem and it is impossible to tell right now. we may not make it long enough to finding out

I've run out of files to make zip files! I'll just use the zip files I made to make more zip files. (it doesn't work)

I mean, they already have. At this point what's the huge unexploited treasure trove of data that HASN'T been mined, or won't have been within months? So, extrapolating, with no new valuable data sets incoming, why would AI get "better" in the future?

That's been rather conclusively disproven by actual researchers...

"If groceries get too expensive, that's fine, I can just eat my own poop."