Comment by jeroenhd

Comment by jeroenhd 3 days ago

0 replies

That's the basic principle. It's a tool to fight to crawlers that spam requests without cookies to prevent rate limiting.

The Chinese crawlers seem to have adjusted their crawling techniques to give their browsers enough compute to pass standard Anubis checks.