not really, but they all have the ability to piss off the wrong deadra and get cursed.

Dunmer are also changed elves, they used to be Chimer and have a similar ish skin colour to altmer. But then because their leaders (the tribunal) pissed off Azura she turned their eyes to volcanic red and skin to ash

Bosmer (probably) used to be unwilling shapeshifters until the green pact, though different in-lore historic accounts might disagree

and that leaves Altmer (from the playable races) who are technically the most direct descendants of Aldmer (the first elves). This is also in part why Thalmor exists, some Altmer see themselves as better than every other elf, and obviously better than the men or beast races. Also they want to destroy the world because they think the Aedra (the primordial spirits that used their powers to create the world and then stayed on Nirn [mortal plane] turning into mortal aldmer and men) made a mistake by staying (or were tricked into staying by Lorkhan), they think Altmer have a claim to godhood and will do anything to take it.