Nah, if she goes (and its likelier that she doesn't, despite everything) it is much more likely to be next year. If things are so bad in mid-2024 that a leadership challenge looks feasible, it is also likely that things are so bad for the Tories that they are beyond salvation anyway.
Being beyond salvation would not deter all ambition to become PM. It might persuade some of the frontrunners to stay back, but that just leaves room for the Andrea Leadsoms of the world to step up to the poisoned chalice. A lot of politicians would trade in the rest of their careers for 6 months as PM, and others would be willing to gamble that they could right the ship.
It could be like the Fourth Labour Government in NZ, which went through three Prime Ministers in one term (though NZ has three year terms not five year ones like the UK). Mike Moore became Prime Minister two months before the election. Labour was doomed by that point but the leadership change was designed to save some seats and arguably it did that even though it was one of the biggest landslides ever, because Labour surged several points in the polls.