Comment by baobun Comment by baobun 12 hours ago 2 replies Copy Link View on Hacker News Mind sharing a decent robots.txt and/or user-agent list to block the AI crawlers?
Copy Link jazzyjackson 9 hours ago Next Collapse Comment - Linked upthread: https://github.com/ai-robots-txt/ai.robots.txt/blob/main/rob... Reply View | 0 replies
Copy Link hooloovoo_zoo 11 hours ago Prev Collapse Comment - Any of the big chat models should be able to reproduce it :) Reply View | 0 replies
Linked upthread: https://github.com/ai-robots-txt/ai.robots.txt/blob/main/rob...