Comment by agnishom

Comment by agnishom 2 days ago

Exactly. I don't understand what computation you can afford to do in 10 seconds on a small number of cores that bots running on large data centers cannot

juliangmp 2 days ago

The point of anubis isn't to make the scraping impossible, but make it more expensive.

Reply View 3 replies

agnishom 2 days ago

by how much? I don't understand the cost model here at all.

Reply View | 2 replies
- eqvinox 2 days ago
  
  AIUI the idea is to ratelimit each "solution". A normal human's browser only needs to "solve" once. A LLM crawler either needs to slow down (= objective achieved) or solve the puzzle n times to get n × the request rate.
  
  Reply View | 1 reply
  
  agnishom 3 hours ago
  
  lets say that that adding Anubis does the job of adding 10 seconds of extra compute for the bot when it tries to access my website. Will this be enough to deter the bot/scraper?
  
  Reply View | 0 replies