You may have reached that age where warmth really starts to win out over a lot of things and that hat looks like it would be lovely and toastie. Speaking as a guy currently wearing a hat in the house, I say go for it!

Honestly my main issue is it would interfere with headphones