Disallowing Robots.txt In Robots.txt Doesn't Impact How Google Processes It
Google's John Mueller said on Twitter that even if you try to disallow your robots.txt within your robots.txt, it won't impact how Google processes and accesses that robots.txt. John said in response to someone asking if you can disallow your robots...
via Search Engine Roundtable https://ift.tt/1sYxUD0
June 29, 2018 at 05:57AM