‘LLMs don’t do formal reasoning - and that is a HUGE problem. Important new study from Apple’ garymarcus.substack.com/p/llms-dont-...

LLMs don’t do formal reasoning - and that is a HUGE problem

Important new study from Apple

I'm confused, this is what the companies producing LLMs have said from the very begining. They're a pile of markov chains, and the interactions become useful when the chains are big enough.

Apple has to pay humans to tell them their LLM can’t reason. … … Guess it’s a darn good thing they still have humans to tell them that, because the LLM wouldn’t.

Here comes another winter