Did they walk into her specific residence, or just the block?
If into a generic block of flats, you can proceed anyway as it's highly unlikely they are going where you were. If unsure, you could have texted the woman from outside to check maybe. If it's a specific standalone house, i.e. exactly her residence they all walked into sure, maybe best avoided, but I would still have checked with the girl first. I have encountered similar experiences, but all was fine in the end. Try to not to let people intimidate you without good reason....