I would vote no, though I would approve unisex toilets, they work, in UK we call them disabled toilets (minor joke) but there isn't issues, just don't have urinals.
I would vote no however that if you are transgender it should be to a fixed point of you are either choosing to be female or male, not dance around them both. but then in honesty after taking a course on reading performance, which is basically philosophy in disguise, who knows. How would this draw up to other cultures, regions, laws, etc, or rather culture cause that what everything comes down to.
Question, is it really going to kill you if you are allocated a toilet space, your taking a number one or two, something both genders do, and isn't something really that requires to be remarked upon.