Whites typically vote more Republican than the nation as a whole. I'm guessing many white people opposed Clinton's stances on many wedge issues (such as abortion, gay marriage, affirmative action, etc.) and thus decided not to vote for him, since Clinton was essential a Republican in terms of economics.
Clinton was against gay marriage and signed the Defense of Marriage Act. He opposed gay marriage on a federal level, which is about as conservative as you can get.
Clinton did very well with white women, who are more likely to vote on issues like abortion, so I don't think that explains white men.
I guess I wasn't specific enough. I meant Clinton was pro-gay rights, which unfortunately many voters oppose. I still think many white men voted against Clinton because they oppose abortion, gay rights, affirmative action, or some other of Clinton's policies.