Your response to "it's too hard" sounds right to me. Take a break. Come back when you're ready. Interestingly, this is one of the examples given by John Holt in "How Children Fail" (if my memory serves, it's at least 40 years since I read it) when he talks of learning flute as an adult.