Comment by account42
Good on you that you found a solution to myself but personally I will just not use websites that pull this and not contribute to projects where using such a website is required. If you respect me so little that you will make demands about how I use my computer and block me as a bot if I don't comply then I am going to assume that you're not worth my time.
This sounds a bit overdramatic for a less than a second waiting time per week for each device. Unless you employ an army of crawlers of course.