# This file is automatically added by servebolt.com to prevent crawlers from overloading # a webpage or server by hammering it endlessly with requests as fast as it can. # Adding a robots.txt file will override this file. # More info: https://service.servebolt.com/server-setup-and-configuration/robotstxt User-agent: * Crawl-delay: 1