Because regardless of how good the sex is at home, I don't think I could ever be sexually satisfied by just one woman.
Yes, I'm selfish, yes I'm dishonest, yes I want to have my cake and eat it too, so sue me, its in my genes.
Punting is far more pragmatic, convenient, safer and easier than multiple affairs.