In thinking about this more, I think I make a distinction between small talk and small-minded talk.

Small talk is just a pleasant, benign way to get to know someone and make gentle connections. I like that kind of small talk. It's fun to hear people's stories, and get to learn about them a little and share little things that will make for fun, pleasant chat.

Small-minded talk is another whole thing that I HATE: and that would include gossip and ego-infested blether.