You should notice, also, that when feminists are suspicious of cis men, they cite statistics of how most sexual assaults are perpetrated by cis men. When anti-trans activists are suspicious of trans women, they cite examples of sexual assaults perpetrated by trans women.
There is a qualitative difference between saying "if most sexual assaults are perpetrated by cis men, then we need to be careful about cis men" and saying "if one trans woman is a rapist, all trans women are rapists."
The latter is not only the logical fallacy of hasty generalisation, it is also an example of fungibility: treating trans women as interchangeable. That is an aspect of objectification, which is distinctly anti-feminist.
I've actually personally had anti-trans activists try to tell me that objection to treating people like objects is "the wrong kind of feminism."