Comment by maltelandwehr

Regular Cloudflare + heavy caching should solve all crawling problems, no?

For most bot visits, there should not be a single database request.