To paraphrase @neilhimself.neilgaiman.com : They are not meant to serve you the truth; they are meant to serve you truth-shaped sentences.
Chatbots aren't search engines. They're pattern recognizers and reproducers. That's it.
"IT'S ALIVE!!" - politics
This is a most succinct aphorism for where we are!
*made out of other people’s stolen truth.
And that's fine, provided that you are aware of this fact and engage them with this in mind.
AI summing up and averaging out most of everything ever saved to the Internet has taught me exactly one thing about facts: "The truth is somewhere in the middle" can only get you a thoughtless wander through hallucination.
Exactly. So why are Google and Bing implementing it in their search when it, by design, doesn’t look for valid results. What many people don’t seem to realize is that LLMs are _always_ hallucinating and that it sometimes appears to coincide with reality.
To me AI is a misnomer for this technology. They are probability matrices that know no context. There is a relationship between one element and the next but little between the first and third or greater.