This “mistake” signifies you might have webpages blocked by your robots.txt that aren’t at this time in Google’s index. The Crawl-delay directive can be an unofficial directive employed to stop overloading servers with too many requests. If search engines like yahoo will be able to overload a server, adding Crawl-delay https://rankingseotoolz.com/robots-txt-generator