If you want to only specify gender then that is the correct word to use. If someone wants to be derogative towards a certain group, the said person can twist the context of almost every known word so that it sounds rude and disrespectful. Does not mean everyone else should stop using that word in the correct context. I don’t know what else to say.