See: the FOSS higs that all flipped out when contributor agreements with codes of conduct like “don’t be homophobic or racist” started popping up.
It was quite a struggle and there is still a large old guard that simply refuses to move on it.
You’re greatly overestimating how many people that is; additionally, it was largely people that aren’t very committed to FOSS that got mad. The project maintainers and most users are fine with it. People who are committed to FOSS ideals are overwhelmingly progressive to leftist. That’s why those codes of conduct were added in the first place, and were largely uncontroversial amongst most actual contributors of those projects.