I think it's similar to the relationship between deontological vs consequentialist ethics.
It's like I view the political/organizational aspects as a 'necessary evil' of sorts- something I refuse to participate in on principle, but want to be okay with happening around me.
Like how MLK was able to be the pacifist front of the civil rights movement while the black panthers filled the necessary militant role. (Huge simplification, I know, but still. Also backwards kind of in this scenario- I'd be working with the BPP).
I want the greatest benefit for the greatest number of people, but I don't want to feel like I'm sacrificing my values to get there.
So if the language around it is adjusted, I can get on board with filling my role. But the moment I feel like I have a superior- I'm out.
Edit: also, the thing I said here
That's fair, I used that term loosely. I guess I meant 'becoming a new oppressive force, simply replacing the previous one (the state)'