Hello,
I was wondering if anyone know if adding "Disallow: /robots.txt" to the robots.txt file work? Would it stop robots from adding robots.txt to search engines and would search engines read the robots.txt with "Disallow: /robots.txt" in it?
This is a discussion on does it work? Disallow: /robots.txt within the General Discussion forums, part of the vBSEO SEO Plugin category; Hello, I was wondering if anyone know if adding "Disallow: /robots.txt" to the robots.txt file work? Would it stop robots ...
Hello,
I was wondering if anyone know if adding "Disallow: /robots.txt" to the robots.txt file work? Would it stop robots from adding robots.txt to search engines and would search engines read the robots.txt with "Disallow: /robots.txt" in it?