Does seem to fit the profile. Do they usually come for the punters or just the guys running it?
Paying for sex is not illegal unless the girl has been coerced.
Even if that were the case, unless they caught you in the act, and even assuming that they have been watching the place for some time, how would they prove that you had, in fact, paid for sex. ... or even had sex .... or even paid any money.
I am fairly sure that speaking to someone on the phone, or visiting the house of someone, later shown to be running a brothel, is not any kind of offence.
I think you're probably safe.
(Asking that question on a public punting forum does make you look like you might have a guilty conscience though

)
