I think the thing to comfort yourself with here is that the procedure to make a fake vagina involves splicing and inverting a penis, and taking grafts from the colon. The, ahem, hole-to-nowhere thus created serves no function, and has none of the usual self-cleaning facilities of an actual vagina, though there is often a reported yellowish discharge; so it is apt to get a little sweaty in there. People undergoing this procedure will be expecting to have to dilate it, at lease daily, oftentimes more, in order to stop it closing in and 'healing'.
Still, thank you for the funny story.
If the girl is legally female, surely that is end of story.
Obviously, this isn't the case. It's a legal fiction designed in the hopes that it might enable people with a serious psychological condition (dysphoria) to find it easier to avoid constant reminders of biological reality in the way societies order themselves. It's a matter of fact that humans cannot change their sex (something the overwhelming majority of 'trans rights activists' acknowledge). The 'girl' was not a girl, and the OP started the transaction on the basis that he is attracted to women, as opposed to men camouflaged through plastic surgery, cosmetics and voice-training to appear harder-to-distinguish.
But I'd say he has no recourse here, other than a funny story and a cautionary tale to tell.