I think the problem some of these people have is that they want to run the place on day one and that is just not how things work. Second, this is more of a war of personalities than anything else. Twitter leadership and actual government leadership are different, but I don't think some people understand that.
Tell that to The Tea Party, they had no issues running over Boehner and the oldies/4chan/internet libertarian crowd were definitely not the same as the Neocon leadership. They didn't understand, and they got things done for it, and finally they got in Trump.
If anything, you just argued why Pelosi ought be run over. Why tactically, they ought call her racist, just like all the red-baiting Gingrich threw out in the '80's eventually landed him the perfect spot in '94.