For me, the most regressive tax appears to be Payroll Taxes. I'd rather eliminate payroll taxes, and fund SS/Medicare from the general revenue, by increasing rates and eliminating some deductions and credits. (Barring that, eliminate the cap.)
I believe the mortgage interest deduction is the most expensive deduction, and one that primarily benefits people who own more than one home. If I'm remembering that correctly, then it should be eliminated or limited to only one home.
I'd be open to eliminating the corporate income tax and estate tax in exchange for creating a minimum effective tax rate for millionaires, and treating dividends as part of normal income and taxed the same way.
Impose risk fees on banks, the higher the fee depending on how high the risk.
Create a carbon tax (but not too high at first).
Make pre-filled tax papers, that save individuals the most money, which they can either choose to accept... or they can still spend the extra time/effort and possibly money having it double-checked.
i agree with pretty much all this... in general personal income tax and certain taxes on consumption should be a bit higher. while corporate taxation should be lowered to be more in line with other countries. although i'd prefer just raising gas taxes to a carbon tax.