Nope, not how it works. You don’t need all of them to vote for one of the major parties. It’s often only a fraction. Florida 2000 final tally was less than 600 votes difference between Bush and Gore. Less than 1% of Nader’s own 97k votes would have needed to flip, and we’d be talking about a very different country right now.
This also applies to a few other states in 2000 that had close votes. Florida wasn’t the only story there, and no, neither was the Supreme Court.
Binary thinking strikes again.