My father lost out on a special post-war scholarship to Cambridge for Jewish boys because of his National Service. This policy might have put him off the Tories if Brexit hadn't already done the job