Well, government or no government, there are always enough other people who could gang up and take any right away from you.
Difference is without a state, you have a legal right to fight them.
Without a state you also don't have laws and an established judicial system so your "legal right" is non-existent.
Without the state and the governing body laying down laws, how are these "legal rights" decided, who decides what people can and cannot do?
Even if we suppose that there is some form of legal system without the state, who exactly enforces the laws?