As with so many things there is a wide spectrum, I only used these labels as I wanted to separate those of us who are only transitory, from those who are permanent or in transition. One of the troubles with labels is that they mean different things to different people, I am happy calling myself a cross dresser, after all that's what I do, yet I am uncomfortable with transvestite, and am not sure what trans gender really means. I am beginning to wonder if there is some sort of hierarchy, you know like "they're a transvestite, you're a cross dresser, I'm trans gender"
All of these terms mean basically the same thing, something quite different from who you are, Joe. I can quite understand that it would be hurtful to be so misunderstood. I know I was quite hurt a while back while I was taunted as being gay. There is nothing wrong with being gay it's just that I'm not. While all of us on this spectrum share some things in common the basic compulsion what drives us, is different, while some activities and techniques may be similar our motivations are very different. I know I am a man born in a man's body, it's just that sometimes I want to look, behave and be treated like a woman ~ sometimes, but I know I am not, and don't want to be permanently., this is very different from wanting to make the outside match the inside. If you like it is the difference between a hobby and a lifestyle.
Sorry this is a little rambling rather than a well thought out coherent argument, but like me this thought is very much a work in progress.