"side piece" being problematic in itself, there are many who would use this wrongly.

A family who sees someone with a partner they don't approve of, the extremely religious not accepting divorce/remarriage etc