Attraction isn't wrong. People can’t help who they are drawn to, and they certainly can’t control affinity, as uncommon as it is. What is wrong is acting on inclination if it hurts someone else, namely a significant other.