I would assume the reason why Christ wasn't baptized until adulthood was because John the Baptist wasn't out conducting his own ministry in Christ's infancy.
Anyway, Baptism is the entrance to the Christian world, in my opinion. We enter the secular world in infancy without our own knowledge - I don't see anything wrong with entering the religious world in similar fashion.
(Though this reminds me of a question I've heard in a faith formation class: Why did Christ even need to be baptized? But that's a different discussion for another time).
There's a whole side literature that the more lay believers largely don't know about as far as questions like that. I was in a session from the pastor about a particular issue and he was using the story of the Pharisees brought the woman accused of adultery to try and trap Jesus saying "the law says to stone her, what do you say?", and Jesus starts writing in the sand before telling them "let he who has not sinned throw the first stone". I thought about that and went up to the pastor after it ended to ask: "what do you think he was writing?" He effectively said there's a long list of literature on that point attempting to answer that, but the only correct answer is we don't know.