He didn't. She left him because apparently he wasn't being a good father to Harvey (who isn't his anyway!)