People of all political persuasions tend to be smug and annoying, especially to those who do not share their ideology.
Yeah, this. Smugness and irritating self-righteous condescending asshattery is a natural byproduct of an ideology. It means you've got It All Figured Out and don't have to think much more. Everyone's guilty of that and I know it's very sagey to say. Casual libertarians have an answer, an absolute that is unachievable but sounds easy. Therefore they can sit high above us all and spout unverifiable ideas without fear of being definitively shown to be wrong. It's very safe, and its emphasis on individuality makes proponents feel strong and secure. There's also an ironic tribal mentality about being part of a kind of movement.
But yeah, those qualities are present to varying degrees in most ideological proponents. Libertarians are just more.. outspoken.