Unfortunately, technology has its benefits but also its drawbacks when comes to privacy. If you give me your regular phone number which you use on Facebook, Linkedin and have used anywhere else on internet, then I may be able tell your full name, about your family and address and may be able to find out where you work etc. Its as simple as that.
You need to play much safer specially if you have a family etc. Many punters would not know that and think nobody knows about them but they are mistaken. The only safe way is use a pay as you go and a spare number for punting and do not use it anywhere else. Not all who sell sex cause problems but you need to just be careful of that one loony who can.