Comment by nicbou

Comment by nicbou 10 months ago

3 replies

I was thinking of that exact strategy for two scraping problems I have. It would be a good way to gently scrape Berlin.de for appointments, and Immobilienscout24 for new flats.

From what I can tell, it would work fine so long as the user is actively looking at those pages.

bangaladore 10 months ago

Yeah, something generic to work for any use case would be nice, but privacy becomes more difficult as you need to tailor the situation to each site to maintain privacy (i.e. only pull the information on the apartment/flat listing, or public tweet or reddit comment, etc...)

  • mewpmewp2 10 months ago

    I wonder if those websites as a response might start adding fingerprint code in the source to indicate whose user session it was.

    • nicbou 10 months ago

      The city of Berlin wouldn't care. The housing website would probably start with lawyers.