Fellow Asperger sufferers: Do you find it hard to convince people that you really do lack social skills?

Whenever I try to explain it to someone, I usually get the old "Well, there are a lot of people that don't like ______." As if my Asperger symptoms are just my likes and dislikes. For instance when I try to explain my repulsion for travel because of my severe social anxieties and my OCD they usually say, "Well, a lot of people don't like to travel." They then usually say to suck it up like everyone else, as if I am just making excuses to do something I don't like to do.