267
Reddit signs $60M contract allowing AI company to train its models on the social media platform's content (www.reuters.com)
submitted 2 years ago by to c/technology@beehaw.org
107 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 2 years ago (3 children)

Whilst true about anyone can scrape data off Reddit, I think it's more of a pain since before the API updates the rate limit was 2 API calls per second. You also have to find or create a scraper. With Lemmy, you follow the instructions (copy and paste) on join-lemmy.org to create your instance and you're done. Both methods you have to configure it to subscribe to communities, so they're about the same.

In the EU at least there is a right to be forgotten, so yeah, Reddit and other platforms are forced to delete the data on request. I'm not sure how the same can be applied to a distributed network like Lemmy.

There were publicly available archives of Reddit. The last time I checked, you couldn't find the latest submissions and comments. Maybe things have changed, maybe newer alternatives have appeared.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 6 child comments
    •
  • [–] 3 points 2 years ago (1 child)

    For the right to be forgotten, this only applies to personal information. E.g. information that can be associated with information, that could be used to identify you.

    Since you usually have an email for signup, that would make the data fall under personal information. But reddit could just delete the email adress and your user name and show something like:

    [deleted]
    When does the Narwhal bacon?

    And well, it is pretty difficult to find out if, when and where there is backups that still contain your information and could be given to the AI model trainers too. To find these things out, we'd need a precedence case that makes a data protection agency investigate reddit throughouly.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 2 years ago

    It's all of the data or just the data that associates content with you, the latter if the company has a genuine reason to keep the content, which a forum generally does.

    If the content cannot be associated with you then does it matter if the content is present on the website?

  • permalink
  • fedilink
  • source
  • parent
  • [–] 2 points 2 years ago (1 child)

    Creating a new instance only gets you access to content that users of your instance have subscribed to, and then mostly only content that comes in after subscription (I believe Lemmy primes the pump a bit on community subs, pulling in a handful of posts at the time of discovery, but discovery is done by users). So, there's a limit on what you can scrape with your own private instance, and you're taking a bit of a bet on which communities will yield what you're looking for in the future.

    It'd be easier and more reliable to just crawl the network and scrape it the old fashion way.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 2 years ago

    "If you search for a community first time, 20 posts are fetched initially. Only if a least one user on your instance subscribes to the remote community, will the community send updates to your instance. Updates include:

    New posts, comments
Votes
Post, comment edits and deletions
Mod actions"

    So you create a single user and subscribe to all communities of interest.

    I probably downplayed the difficulty of setting up a Lemmy instance that will come if you do something out of order or don't quite have the host set up correctly or something. Although I do think it's easier than pigging about with web crawlers.

  • permalink
  • fedilink
  • source
  • parent