This doesn’t have any impact on video load times on Piped, does it?
Why would it? I don’t think your browser makes any direct connection to youtube.com when using Piped, all goes through a proxy server of your choice (hence the name).
Invidious and Piped fix this issue. You can use LibRedirect to automatically redirect all YouTube links to Invidious or Piped.