Defying authority isn't the same as being self-indulgent.
Your are right, and I am not conflating the two, but insisting on individual freedoms
is indulgent - as are many of the choices people make to exercise those freedoms in contradiction to the expectations of duty to friends, family, community, or country. There are many instances where what feels like good judgement or benign fun to someone with progressive sensibilities appears decadent, impure, irresponsible, selfish, etc. to a person with a more traditional outlook.
For better or worse our camp doesn't hold itself up to all of the lofty standards that apply on the Right. Likewise, conservatives tend to fall short of our narrower, yet more intensely valued set of expectations.