113 points
*
Deleted by creator
permalink
report
reply
15 points
*

but not the misuse of public content

Is that an admission that they don’t own the content others posted on their site?

permalink
report
parent
reply
4 points

you would be a good lawyer

permalink
report
parent
reply
70 points

I am confused, does this mean Reddit is not going to be searchable on search engines anymore?

permalink
report
reply
85 points

Unfortunately yes. It was reported on last month.

permalink
report
parent
reply
65 points

oh no, Reddit is like, the only way to have google still be useful.

permalink
report
parent
reply
54 points

Funnily enough, google is also the only way to have Reddit be useful.

Their own search function has been nothing but garbage.

permalink
report
parent
reply
43 points

That’s the catch, Google made a deal with Reddit and remains the only search engine allowed to access its data for indexing. It cuts off every other search engine

permalink
report
parent
reply
27 points

Tell me that there is an anti trust suit over this.

permalink
report
parent
reply
3 points

really? ddg will show me reddit links, did they have to make a webscraper or something

permalink
report
parent
reply
31 points

We fucked the internet. It’s proprietary now.

permalink
report
parent
reply
11 points
*

we fucked the internet

kinky

permalink
report
parent
reply
9 points

Good news! Google paid up and still has access I’m pretty sure.

permalink
report
parent
reply
1 point

That’s bad news, that means the internet is dying

permalink
report
parent
reply
9 points

Perhaps, likely depends on the crawler though

permalink
report
parent
reply
12 points

Yeah i dont think ignoring robots.txt is even illegal. They can ofcourse just block your crawlers IP but that would be a cat and mouse game that they would lose in the end.

permalink
report
parent
reply
54 points

Not gonna lie this seems like ultimately a win for the Internet. The years of troubleshooting solutions Reddit Provided can be archived (hopefully) but the less people rely on the site itself, the better. At least in my opinion.

permalink
report
reply
2 points

I disagree, kinda. Stackoverflow is the other option for questions which is a lot less user friendly, and Lemmy has never shown up in search results for me. If something comes along and makes it simple, great! however I just see a lot more of ad filled hellhole sites in the meantime.

permalink
report
parent
reply
52 points

I remember finding Google’s robots.txt when they first came out. It was a cute little text ASCII art of a robot with a heart that said, “We love robots!”

permalink
report
reply
50 points

An ancient text from the before-fore.

permalink
report
reply
60 points

this is actually quite recent. the old one was much funnier and clearly had actual soul put into it.

permalink
report
parent
reply
6 points

my shiny metal ass

permalink
report
parent
reply