Simple answer. Tell the neighbours You met her on a night out and invited her round for a quickie while her husband is at work.
There can be a million reasons a woman visits your house not just cause she is a prossie. Measuring for curtains, landlord, bible salesperson the list can go on.