Comments

9 points

robots.txt is a suggestion, and using it to block malicious actors is pointless.

permalink
report
reply
6 points

Unfortunately, yeah. AI industry has proven that it’s willing to beg for forgiveness rather than asking for permission.

permalink
report
parent
reply
5 points

Scrapers are not new. They’ve been doing this shit for years, the result of the scraping is just more transparent to the general internet public now.

They’ve never asked permission.

permalink
report
parent
reply

Pulse of Truth

!pulse_of_truth@infosec.pub

Create post

Cyber Security news and links to cyber security stories that could make you go hmmm. The content is exactly as it is consumed through RSS feeds and wont be edited (except for the occasional encoding errors).

This community is automagically fed by an instance of Dittybopper.

Community stats

  • 1.3K

    Monthly active users

  • 825

    Posts

  • 707

    Comments

Community moderators