Doesn’t the fact that it’s called “Generative AI” imply that it’s just making shit up?

Pretty much. It just build sentences that might look like answers to your questions. I really hope this bubble bursts soon.