That assumes selfish self-interest to be man’s primary motivator, rather than altruism and cooperation. People would build homes, work fields, labor in factories, perform customer service, prepare food, etc... to provide for others in their community because, in return, others will provide for them. There would be increased difficulty in terms of movement, which has to be worked out, when you won’t have an abundance of available, unoccupied housing units. However, you’d resolve the issue of homelessness when income is no longer the gatekeeper of housing.
So they act out of self interest?
Money is literally just a very liquid representation of what you've done for others which you can in turn use to give others when they do things for you. It's the only way we can line up this mutual, self-interested altruism in a community of any size. The key is to build a system where everyone acting in self interest allows the greatest common good to flourish and we call that system the market economy.