Comment by TeMPOraL
> For whatever reason they didn't choose to use accessibility tooling to automate agents
That surprises me too. It's arguably the only way forward that has a chance of surviving for more than a moment, because accessibility actually has a strong cultural and (occasionally) legal backing, so companies can't easily close that off.
I was genuinely (maybe naively) impressed when google pushed for https everywhere. Maybe there were nefarious reason behind it that I missed, but it did a lot of good for the average web user.
LLM companies could easily have made a similar impact by leaning on accessibility tooling. Pushing companies to better support ARIA standards online would have made a huge impact for the better.
Heck, throw a little of that LLM money towards browser vendors to even better support ARIA - personally I'd love to see a proper API for directly accessing the accessibility tree.