I think I'm with you. One of my sons is just like my DH--that is to say, extremely gregarious and outgoing. He's convinced that I'm a misanthrope, simply because I say things like, "I LOVE it when my neighbors leave for the winter" or "Oh, do we HAVE to invite so-and-so for dinner? I'm just not into it."
I also find that I typically like volunteer opportunities until I learn that it involves going to meetings. My favorite volunteer activity so far has been Meals On Wheels, because I drive by myself and I hand people their meals and I'm out of there in seconds.
Of course I do enjoy DH's company and the company of my children, but that being said, I think the person I've been most envious of lately has been Thomas Merton--I learned from a podcast that he became a hermit in his later years. I could probably do that, as long as I could get a dog if I got lonely.