Weird ass religion.
So wait, they have separate churches for blacks and whites, but it's still considered the same denomination? Like lol.
That's the congregational polity. Its all voluntary now that segregation doesn't have force of law. If a Baptist believer can choose to join any Baptist church, and a Baptist church can choose to affiliate with any Baptist convention, it's no surprise that so few would want to join some group where they're in the perpetual minority (and if they chose to at some point, might be uneasy if the relevant conflicts come up). Likewise, a convention could expel a church or a church could expel a member, though that's less common than just voluntarily leaving a group you tend to disagree with.
Edit: Baptists are less likely (especially compared to Catholics / Orthodox) to hope that all Christians will be united organizationally. Their voluntary cooperation makes it impossible. Congregations exist to provide necessary connection and guidance to believers, but denominations are always discussed as a cooperation, not a hierarchy.