Infidelity, when performed in a physical manner, is relatively cut and dry. You engage in physical contact or a sexual affair with another person who is not your partner. But what about emotional infidelity? This is harder to provide a clear boundary for.