The overwhelming vast majority of people who are born in families with a networth of around 1-5 million or so do not accumulate $250 million. Regardless of your snide political opinions - both Romney and Obama are remarkable men.
George Romney was worth more than $5 million in today's dollars. Mitt was born with a silver spoon in his mouth, there is no denying that. He had significant advantages that President Obama and 98% of all Americans did not. I don't care if Mitt donated all his inheritance to BYU; he had already gotten the leg-up due to his father's connections well before he died. Mitt had ran Bain Capital for 10 years before his father's death.
George Romney also built his wealth honorably, by being the President of a company that produced a product of value for customers and hired several hundred thousand middle class workers. Mitt Romney, on the other hand, built his wealth through Wall-Street overleveraging that built value for the select few, while leaving desolate communities to pick up the tab.