No, we should keep the penny.
It is that simple.
Is it now? And you are not bothered by the fact that we spend hundreds of millions of dollars every year pumping out a tiny piece of plated zinc that most people will just end up throwing away? I don't know what they ave done to the new pennies, but they tarnish so easily now anyway. If you haven't washed your hands in a while and you press your fingure on one, within a week there is a good chance that you finger print will be perminantly worn into the surface.