If you have the August 13, 2024—KB5041580 update. You’re good.
IPv6 is enabled by default on windows.
EDIT Here’s how to disable it. If you can’t on your modem/router. Open the network menu from the icon in bottom right of screen > right click on the network you are connected to and click “status” > In the popup click on the “Properties” button > You’ll get another popup with the name of your network adapter in a top line/box and a secondary box with a list of things in it > Look for the entry “Internet Protocol Version 6 (TCP/IPv6)” and uncheck the box in front of it > click OK.
you can have both addresses at the same time - this site shows both if you have them: https://whatismyipaddress.com/