There shouldn't be a single age of consent, but a moving one based on age difference (for example, a 17-year-old with a 19-year-old is far less objectionable than an 18-year-old with a 40-year-old).
Is there any evidence that having sex with someone who is 40 or so is harmful or so when you're 20-22? These laws were made to protect children from adults wanting to abuse them, but I don't really think someone in his/her early 20s needs protection from these kind of things and I also don't think we should abuse these laws to ram societal standards through people's throats.
Anyway, 16 or 18 with a "Romeo and Juliet" provision (see RINO Tom's post) sounds about right.