▲ 1018 ▼ Chad scraper (sh.itjust.works) submitted 2 years ago by dramaticcat@sh.itjust.works to c/lemmyshitpost@lemmy.world 93 comments fedilink hide all child comments
[–] kattenluik@feddit.nl 2 points 2 years ago (1 child) I'm guessing forms like this have CSRF protection, so you'd probably have to obtain that token and hope they don't make a new one on every request. permalink fedilink source parent hideshow 2 child comments replies: [–] Lemmesee@lemm.ee 2 points 2 years ago Good point. This is also possible to overcome with one additional HTTP request and some HTML parsing. Still less overhead than running Selenium! In any event, I was replying in a general sense: Selenium is easy to understand and seems like an intuitive solution to a simple problem. In 99% of cases some additional effort will result in a more efficient solution. permalink fedilink source parent
[–] Lemmesee@lemm.ee 2 points 2 years ago Good point. This is also possible to overcome with one additional HTTP request and some HTML parsing. Still less overhead than running Selenium! In any event, I was replying in a general sense: Selenium is easy to understand and seems like an intuitive solution to a simple problem. In 99% of cases some additional effort will result in a more efficient solution. permalink fedilink source parent
