I don't think there is anything wrong with you, you have to sit outside the situation and ask yourself, how would you feel if you were the wife. See the husband is happy because he knows you won't leave him alone and as long as his wife doesn't find out he has it made.