Comment by patmcc

Comment by patmcc 5 hours ago

4 replies

I'm now expecting we'll see a couple things in the next few years:

1. An explosion of residential proxy networks and other stuff to circumvent blocking of cloud IP ranges, for all the various AI scraping tools to use.

2. A corresponding explosion of countermeasures to the above. Instead of blocking suspicious IPs, maybe they get a 3GB file on their request to /scrape-target.html

bdcravens 5 hours ago

Perhaps an explosion of usage. There's already a few very large residential proxy networks.

  • cute_boi 2 hours ago

    And, I get frequently contacted by Bright data to install their code in my repo.

mrtesthah 5 hours ago

I think that may be against the ToS of most residential ISPs.

  • bdcravens 5 hours ago

    Perhaps, but it's already fairly prodigious. Among "ethical" providers, it's often bundled as a background service in a lot of clickwrap "freeware". (To say nothing of compromised computers in a botnet)