tcit a day ago

Not exactly (site:gitlab.open-xchange.com in a search engine gets you the links to access the projects directly), but the explore page is indeed restricted.

Reply View 0 replies
cyberax a day ago

You can thank AI bots for that.

Reply View 2 replies
  • zenmac 19 hours ago

    Wow didn't realize it has comes to this. I guess the AI bots are ignoring the robots.txt now days huh, so just removing the index seems enough to stop the AI scrappers?

    Reply View 1 reply
    • cyberax 14 hours ago

      Yep. I have my own small gitweb server, and I was getting literally thousands requests per second from bots who try to crawl through all the links.

      Reply View 0 replies