Ignoring the banhammer bait 'some people' and 'only sexual violence' wording. I'd put it to you that they are both terrible things and its a waste of time to be unsympathetic to anyone who experiences either one of them. But if you want an answer, people might perceive that because its trauma and shame that they have to live with, and the thing with trauma is its very hard to quantify or see but it is extremely real to them, its also trauma that can come up again and again as they try to move on and meet people.