The problem with Herbert is he's a one-joke character. Family Guy handles one-joke characters better than most shows by managing to branch out from that one joke (see Quagmire) or evolving greatly (Meg for example is no longer treated as a mocked punching bag, mostly because fans didn't really find the way she was abused that funny after too long so she regularly gets wins now, and Stewie is no longer obsessed with world domination or killing Lois) but Herbert hasn't.
The real disappointment although not a surprising one to me is the lack of Sneakers O'Toole.
What would your reaction had been if Ireland's favourite character was Sneakers?