If a party is saying we should leave the ECHR, we definitely need it to protect us from them.

Agreed, but let's imagine Jenrick becomes PM and joins Russia and Belarus out of ECHR. I'm pretty sure Labour will say, "It's a settled matter, and we won't seek to return."