Comment by patmcc

>>>and it's legal to scrape publicly available data, even if the websites hosting it try to block it

Is that something that's been fully decided? https://en.wikipedia.org/wiki/Craigslist_Inc._v._3Taps_Inc. is the most relevant case I'm aware of, and it suggests it might actually be illegal (if you know you've been blocked, at least).