I think once you start defining your religious liberty as a right to tell other people how live their lives and a right to only associate with people of the same religious practices, you turn the idea of individual liberty on its head. If you want personal freedom, you need to accept the exercise of personal freedom from other people.
This is all true, but it goes both ways. People shouldn't be able to tell homophobic businessmen how to live their lives anymore than they should be able to tell gays how to live theirs'.