I was politely told to back off at the Frick once.

I too have gotten this notification at Musée d'Orsay and the Kimbell. I wear glasses, and sometimes they get in the way, but I'm nearsighted, so I will pull them down and lean in, and sometimes they really don't like the leaning in.