Can u sue the people who challenged you?

I would sure try. Violation of my civil rights to challenge my vote without evidence of wrongdoing.