One reason to support a minimal state is because you view the state as the primary mechanism by which dominant groups oppress marginalized ones. But it turned out a lot of "libertarians" want a minimal state because they view the state as the primary mechanism *preventing* them from being oppressors
When Trump's success offered up the possibility of using the state to enact and reinforce right-wing hierarchies and domination, many of those "libertarians" flipped from opposing state power to supporting it. Their interest was never liberty, it was power, for themselves and their favored groups.
"Every movement that seeks to enslave a country, every dictatorship or potential dictatorship, needs some minority group as a scapegoat which it can blame for the nation’s troubles and use as a justification of its own demands for dictatorial powers." aynrandlexicon.com/lexicon/busi...
Your first sentence is the EXACT reason I support a minimal state. As I always express it, "The only way to keep power from being abused is to minimize the amount of abusable power."