american social conservatism is built upon hurting people who are different, tends to be horribly racist, etc.
You are right, but the exact same can be said American economic conservatism. And they have been far more successful in hurting people.
This is because social conservatism ultimately just wants people rewarded for good things for the right reasons and doesn't instantly or apathetically accept whatever the hell label or identity is given and then attack everyone else for not being so instant.
Economic conservatism/libertarianism rewards people for success regardless of the ways in which they get it.