Comment by Almondsetat

Comment by Almondsetat 3 days ago

4 replies

View on Hacker News

Scrapers are orders of magnitude faster than humans at browsing websites. If the challenge takes 1 second but a human stays on the page for 3 minutes, then it's negligible. But if the challenge takes 1 second and the scraper does ita job in 5 seconds, you already have a 20% slowdown

mewpmewp2 3 days ago

By that logic you could just make your website in general load slower to make scraping harder.

Reply View 1 reply
  • Almondsetat 3 days ago

    No, because in this case there are cookies involved. If the scraper accepts cookies then it's trivial to detect it and block it. If it doesn't, it will have to solve the challenge every single time.

    Reply View 0 replies
rfoo 3 days ago

Scrapers do not care about having a 20% slowdown. All they care is being able to scale up. This does not block any scale up attempt.

Reply View 0 replies