Comment by rezonant

Comment by rezonant 2 days ago

7 replies

It only challenges user agents with Mozilla in their name by design, because user agents that do otherwise are already identifiable. If Anubis makes the bots change their user agents, it has done its job, as that traffic can now be addressed directly.

samlinnfer 2 days ago

This has basically been Wikipedia's bot policy for a long long time. If you run a bot you should identify it via the UserAgent.

https://foundation.wikimedia.org/wiki/Policy:Wikimedia_Found...

  • 1vuio0pswjnm7 a day ago

    It's only recently, within the last three months IIRC, that Wikipedia started requiring a UA header

    I know because as a matter of practice I do not send one. Like I do with most www sites, I used Wikipedia for many years without ever sending a UA header. Never had a problem

    I read the www text-only, no graphical browser, no Javascript

hshdhdhehd 2 days ago

What if everyone requests from the bot has a different UA?

  • skylurk 2 days ago

    Success. The goal is to differentiate users and bots who are pretending to be users.

  • trenchpilgrim 2 days ago

    Then you can tell the bots apart from legitimate users through normal WAF rules, because browsers froze the UA a while back.

hsbauauvhabzb 2 days ago

Can you explain what you mean by this? Why Mozilla specifically and not WebKit or similar?