Comment by ed_mercer

APIs are too unreliable + they throttle/429 and may ask for KYC. In contrast, HTML works everywhere and scraping code barely needs to be changed. An API is only useful when content is behind a login paywall, and only needed for legal reasons.