Comment by throwawayffffas
Comment by throwawayffffas 4 days ago
I don't think there are any.
Because servers would serve different content based on user agent virtually all browsers start with Mozilla/5.0...
Comment by throwawayffffas 4 days ago
I don't think there are any.
Because servers would serve different content based on user agent virtually all browsers start with Mozilla/5.0...
Anubis will let curl through, while blocking any non-mainstream browser which will likely say "Mozilla" in its UA just for best compatibility and call that a "bot"? WTF.
curl, wget, lynx, and elinks all don't by default (I checked). Mainstream web browsers likely all do, and will forever.