The difference is this: in the case of the man voting for Trump and the woman voting for Trump, the target of sexual abuse is the woman. And the men are allied in their cruelty and abuse of women.
And the woman is simply foolish and self destructive.
During the Holocaust, some victims were made to dig their own graves and stand at the edge. The Nazi would then, one-by-one shoot the victims who would fall into their graves. Your reasoning would hold the Nazi and the victim equally responsible.