[How To] Completely Turn Off the vBulletin Archive

Yes , it is suggested to create a robots.txt file

Originally Posted by Mert Gökçeimam

Yes , it is suggested to create a robots.txt file

What all needs to go inside this file?

Thanks, dreck

Hello Dreck ,

You can check robots.txt

Thanks!

You're welcome

thank you michael

You are welcome

Step 3: Disable search engines from indexing archive:

• Inside of your robots.txt, you should add the following lines to the bottom. (If you had a custom location for your archive, then please add that just like the following)
  
  • Disallow: /sitemap/
  • Disallow: /archive/

-------------------------
Can some one tell me where this is or how and where do I do this please?
using vb3.83 I'm trying to do the above!

In your site root you will found robots.txt and if you didn't have it you can create new .txt file and add the above lines and upload it in your site root

Trying to complete these tasks - I need some help.

What is "Remember to have your config_vbseo.php CHMOD to at least 666", no idea where to find this or what it is.

Also, I have no robots.txt file in my /home/mainwebsite.html/ directory (which is my root directory) - does this mean I should just create one with 2 lines in it:

Disallow: /sitemap/
Disallow: /archive/

As a note - any idea why I don't have one ?

Originally Posted by systemsfortraders

Trying to complete these tasks - I need some help.

What is "Remember to have your config_vbseo.php CHMOD to at least 666", no idea where to find this or what it is.

Also, I have no robots.txt file in my /home/mainwebsite.html/ directory (which is my root directory) - does this mean I should just create one with 2 lines in it:

Disallow: /sitemap/
Disallow: /archive/

As a note - any idea why I don't have one ?

you will found config_vbseo.php in includes/

------------

Robots.txt
if you didn't have robots.txt in your site you will need to create new robots.txt file and add these 2 lines then upload it to your site

Originally Posted by systemsfortraders

Trying to complete these tasks - I need some help.

What is "Remember to have your config_vbseo.php CHMOD to at least 666", no idea where to find this or what it is.

Also, I have no robots.txt file in my /home/mainwebsite.html/ directory (which is my root directory) - does this mean I should just create one with 2 lines in it:

Disallow: /sitemap/
Disallow: /archive/

As a note - any idea why I don't have one ?

Your config_vbseo.php is in your ./includes/ folder. If it is not writable, than you will need to right click it in your FTP client and change the CHMOD to at least 666.

As for not having a robots file, your website will not have one unless you add it. You should use:

User-agent: *
Disallow: /sitemap/
Disallow: /archive/

Robots.txt file created in my /home/mainwebsite.html/ directory to just include the 3 lines of code identified above - thanks.

Having a problem with FTP CHMOD thing - I have my ftp address/username/password/ but I have no idea to do what you are asking here - can you please provide more detailed instructions.

Thanks,

in most ftp clients, you can right click on the folder and find either "file permissions" or "chmod" on the context menu.

Mine doesn't - Just gives read/write etc access tick boxes - Site is working at present - does this mean it is ok and I can forget about or should I still try and check it out ?