I feel like every day I come across 15-20 "AI-powered tool"s that “analyze” something, and none of them clearly state how they use data. This one seems harmless enough, put a profile in, it will scrape everything about them, all their personal information, their location, every post they ever made… Nothing can possibly go wrong aggregating all that personal info, right? No idea where this data is sent, where it’s stored, who it’s sold to. Kinda alarming

26 points

A toy like that is easy to create and not that expensive to offer. Much more expensive than some JavaScript or CSS, but in the end it’s not that different.

I think people don’t really understand this whole scraping thing. For example, you can torrent all of Reddit until the API-change; all the comments, profiles, usernames, including now deleted stuff. There is a lot of outrage here over Reddit cracking down on these 3rd party tools. It’s difficult to see how that outrage over cracking down on 3rd party tools, fits with this outrage here over not cracking down on 3rd party tools.

Anyway, if someone want to archive all of Bluesky, they don’t need to offer some AI toy. They can just download the content via the API.

permalink
report
reply
4 points

You can still torrent Reddit pushshift data past the API change. But yea I definitely agree otherwise, these are just cheap toys that less experienced developers create for portfolios.

permalink
report
parent
reply
-9 points

A toy like that is easy to create and not that expensive to offer.

Right, and the developers of Bsky didn’t think to maybe block something that scrapes all that personal information?

permalink
report
parent
reply
16 points

Like Lemmy or Mastodon, BlueSky was made with the idea of federation. While BlueSky is not there yet, federated services are inherently very easy to scrape.

Maybe it’s time for people to understand that anything they post/vote/comment/like should be considered public domain.

permalink
report
parent
reply
7 points

If that’s what you want, you should join Facebook.

The fundamental thing to understand is that the internet - and really all information processing - is about copying. There is no such thing as “looking” at a profile or a post. The text and image data is downloaded to your device. You end up with multiple copies on your device.

Sending information out, but blocking people from storing it, is fundamentally a contradiction in terms.

Bsky - like Lemmy - made the choice to make the data widely available. It is available via API and does not need to be scraped. The alternative is to do it like Reddit or even Facebook or Discord. But they can’t stop scraping, either. They can make it slower and more laborious but not stop it. Services like Facebook protect the data as best as they can to “protect your privacy”. In reality, it’s about making it hard for you to leave the platform or anyone else to benefit from your data. Either way, you can trust Zuck to protect your data as if it was his own. Because it is.

permalink
report
parent
reply
5 points

That would always by definition block all third parties.

Think of the reddit example from the person you replied to: there was a huge outcry when reddit announced shutting down their lower API tiers.

Either information is free to flow or not at all, there is no middle ground.

With that in mind: I’m sure they thought about it and decided to prioritize transparency she flexibility over security. Personally I support that decision.

permalink
report
parent
reply
-4 points

I know how APIs on reddit work, but you can block people who misuse the API if they’re doing something nefarious. Some of these AI are in my honest opinion very taxing on hardware. Having to retrieve millions of posts, comments, pictures, text, on demand… and send that to who knows where for AI scraping… Sounds very costly.

permalink
report
parent
reply
2 points
*
Deleted by creator
permalink
report
parent
reply
19 points
*

The only money to be made in the LLM craze is data scraping, collection, filtering, collation and data set selling. When in a gold rush, don’t dig, sell shovels. And AI needs a shit ton of shovels.

The only people making money are Nvidia, the third party data center operators and data brokers. Everyone else running and using the models are losing money. Even OpenAI, the biggest AI vendor, is running at a loss. Eventually the bubble will burst and data brokers will still have something to sell. In the mean time, the fastest way to increase model performance is by increasing the size, that means more data is needed to train them.

permalink
report
reply
3 points

Hey hey, there’s a flourishing market for NSFW ai chatbots that I’m sure is raking in the cash essentially re-selling access credits at a higher price.

permalink
report
parent
reply
15 points

AI has tons of money.

AI companies either do this scraping, or they buy data from others who have done such scraping.

Since the AI companies are sitting on full treasure chests (venture capital), there is a vibrant market at the moment.

permalink
report
reply
6 points

LLM is at its core just a text processing tool. For it to be remotely useful when you’re not generating text from nothing, you need data to process. Preferably larger amounts so you appear more useful. Scraping websites like this is a good way to get source data useful for an individual who you’re trying to convince to give you money.

permalink
report
reply
4 points

So you’re saying LLM is a pyramid scheme?!? Pardon me while i clutch my pearls.

permalink
report
parent
reply
3 points

AI “tools” like this are an absolute piece of piss to create, and they are also the kind of thing that bro investors love to throw money at currently

permalink
report
reply

Technology

!technology@lemmy.world

Create post

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


Community stats

  • 15K

    Monthly active users

  • 6.7K

    Posts

  • 152K

    Comments