It's not simple; you're claiming that this is what defines being "straight". That's not obvious to me. I can imagine a world where straight men are interested in the current genitalia and not bothered by previous genitalia.