There's some argument to be made that Section 31 is a semi-autonomous group that most of Starfleet doesn't know about and the ones who do are afraid of, also that by the DS9 era it might literally be one guy

Discovery (and the Abrams movie) handle it idiotically but the idea of Section 31 as a secret cancer within the Federation is an intriguing one