I think he was just on the "fezzes are cool" bandwagon like many of us Whovians were. I still must put one on whenever the opportunity arises.