I'm fairly certain that the problem with using "they" comes when you know someone's pronouns and use that pronouns to intentionally misgender someone. I could be wrong but that's how I, personally, see it