199
Reddit locks down its public data in new content policy, says use now requires a contract (techcrunch.com)
submitted 2 years ago by to c/reddit@lemmy.world
25 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 22 points 2 years ago (3 children)

Probably what they’re targeting. Such as sites like safereddit, etc.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 6 child comments
    •
  • [–] 38 points 2 years ago (2 children)

    Well that's part of the thing. Web scraping doesn't get covered by policies. Like, they could ban your ip or any accounts you have, but web scraping itself will always be acceptable. It's why projects like NewPipe and Invidious don't care about YouTube cease and desist letters.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 3 points 2 years ago (2 children)

    Oops look like this community hasn't been reviewed. Login if you still want to see the content.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [+] 1 point 2 years ago* (last edited 2 years ago) (1 child)
    [deleted]
  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [+] 1 point 2 years ago* (last edited 2 years ago) (2 children)
    [deleted]
  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 1 point 2 years ago (1 child)

    Parsing absolutely comes with a lot more overhead. Especially since many websites integrate a lot of JS interactivity nowadays, you oftentimes don’t get the full contents you’re looking for straight out of the HTML you’re getting out of your HTTP request, depending on the site.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •