Just because you can't criminalize hatred does not mean that we should accept it as a society. There should be social consequences for bigots. I wouldn't advocate for killing or arresting nazis, but I am 100% okay with shutting them out so that they don't feel welcome, either in the discourse or in society at large.
Ok, no one is stopping you and all the people who agree with you from doing exactly that and I think you've already won that battle (explicitly racist discourse is
not welcomed in society). However, government regulation should not target speech which occurs privately. If we're talking about conservatives not being able to be teachers or whatever, then yeah that's crazy