I swear at that moment he pauses like he expected the audience to start booing, and seems mystified when that doesn't happen

Or applauding, or cheering, or just reacting *somehow*. And becomes entirely speechless when they don't respond to him at all.