It depends how often you do it too.
If you only punt, say, 2-3 times a year, then you can manage this side of you and push it out of your mind for long enough without it becoming an issue for you and your partner.
However, if you do go frequently, each time saying 'never again', then there probably are issues here that should be talked about with a professional. In this scenario, you may not want to punt, yet still do it anyway. Replace punt with drink, and that is a cause for alarm, isn't it?