Actually, Kai...
http://www.perthfurs.net/It would seem that you aren't
quite alone out there.
As far as your concerns about being out in public, I can't give you much advice; I don't know much about your community. However, it can't hurt to be prepared for at least a little curiosity out of the general public. Negative comments are thankfully rare, and almost never to the point that they can't be ignored, while anything else gives you an opportunity to find potential furrends.
Fun example: I went to an office supply store yesterday for printer ink, and of course wore my collar. The girl at register was about my age and quite outspoken.
"Is that a dog collar?"
"Well, yes. Yes, it is."
"Why would you WEAR a dog collar?"
"Because the cat collar wouldn't fit."While true (I have a ~16" neck, too big for your average cat), the answer was humorous enough to get the girl laughing. Potential embarrassment avoided, and I got my ink.