Do you just go to the home/feed and let it be fed to you? Do you have things you follow specifically and nothing else? Somewhere in between?
I don’t see a way to do it in Voyager’s settings, but if you go to lemmy.world in a web browser and go to your settings, there is a “Block” tab at the top next to settings. Go to that and you can block users, instances, or communities.