Personally I've liked both GURPS and OSR ways to deal with this. GURPS you get penalties, but you also get bonus points to offset it; it's a myth that you get sharper other senses or whatever, but hey, game balance, free points. In OSR, numbers have swings anyway, who cares about a -1 or -2.