Cutting little things like this out of the budget will not accomplish much.
Actually, we should encourage budget cuts whereever possible of unnecessary funding to ensure that actual necessities can be adequately paid for (i.e. soldier salaries). The argument that this didn't save us much money holds no weight; it still saved a little bit of money regardless, and that's not a bad thing. At what point does something become large and expensive enough that you would support its abolition?
Either way, I am morally opposed to forcing people to give money to the government to subsidize artwork that those people may not like or agree with. It is simply wrong for people to pay taxes for artwork that they find tasteless, offensive, or even pointless (as can be the case with abstract art).