Comment by BryantD

Comment by BryantD 6 months ago

8 replies

It would indeed. Note the warning: "There is not currently a way to differentiate between web crawlers that are indexing sites for search purposes, vs crawlers that are training AI models. ANY SITE THIS SOFTWARE IS APPLIED TO WILL LIKELY DISAPPEAR FROM ALL SEARCH RESULTS."

jsheard 6 months ago

Real search engines respect robots.txt so you could just tell them not to enter Markov Chain Hell.

  • throwaway744678 6 months ago

    I suspect AI crawler would also (quickly learn to) respect it also?

    • jsheard 6 months ago

      In that case, mission accomplished.

    • [removed] 6 months ago
      [deleted]
rvnx 6 months ago

It's actually a great idea to spread malware without leaving traces too, it makes content inspection to be very difficult, view-source: to be broken and most of debugging tools, saving to .har, etc.

[removed] 6 months ago
[deleted]