And this sort of response is why I disagree that this will all that adversely affect Romney's campaign. It's insulting to the people who are voting for Obama, but most of the people who would vote for Romney probably agree with it and say "of course". It's unsurprising to both sides that he'd hold such a view.
Yes; a gaffe is only damaging (genuinely damaging) if it alters perceptions.
The nuances of the gaffe (ie insulting senior citizens, vets, students etc) are difficult to communicate well. However it could prove useful at the debate. It's the Mexican gaffe that is potentially more damaging.