He was also fiercely protective of Andrew Ridgeley through the years