Interesting question: is LLM-generated speech useful for LLMs? (Otherwise, the model self-defeats, see the discussion in the thread below.) My guess: yes, it is useful, because the time and context in which it is generated are not random. They carry valuable information.

Perhaps known better by colleagues in #linguistics.