Comment by philipwhiuk Comment by philipwhiuk 6 hours ago 1 reply Copy Link View on Hacker News Are you sure you're not just encouraging more people to run them?
Copy Link andrethegiant an hour ago Collapse Comment - Even so, traffic funnels through the same cache, so website owners would see the same amount of hits whether there was 1 crawler or 1000 crawlers on the platform Reply View | 0 replies
Even so, traffic funnels through the same cache, so website owners would see the same amount of hits whether there was 1 crawler or 1000 crawlers on the platform