There's plenty to hate about the "pure" forms of both quadrants (i.e. Stalin vs. Murray Rothbard, basically)
I think one of those people clearly caused more real world harm than the other.
Well, yes; he was given a lot more opportunity to. What tankies say of "true" communism actually is true of "true" libertarianism* in that it's a largely untested ideology.
*not that Murray "police brutality is Good, Actually" Rothbard was really all that libertarian, but he certainly was in the bottom right quadrant!