Try to remember robots.txt could be the portion where you are issuing instructions to the major search engines robots on which directories they must not stop by. Check for syntax errors. A single error inside the syntax of the Robots.txt file can result in it to fail, so be sure https://rankingseotoolz.com/robots-txt-generator