Comment by tomhoward

We built the company from the start by scraping low cost airlines, and always did a lot of it.

It’s just a very big undertaking - building all the scrapers, maintaining them (every time any detail of an airline website changed), getting around anti-scraping measures, running servers, and even then your data is out of date as soon as a flight’s price or availability changes. And it’s an exponentially growing undertaking the more comprehensive you want your index to be - I.e, to include round trip and multi-stop tickets.