vBulletin SEO Forums

SEO

vBulletin Search Engine Optimization

Buy vBSEO Now! HACKER SAFE certified sites prevent over 99.9% of hacker crime.
ne nw
New vBSEO Discount Level for Network Builders Meet vBSEO Team in New York (Nov. 3rd & 4th) vBSEO 3.2.0 GOLD Has Landed Success with vBSEO = 600ore Web Visitors + $1400 in a Day! Crawlability Inc. Files for SEO Technology Patent
se sw

Can I get help testing to make sure

This is a discussion on Can I get help testing to make sure within the Troubleshooting forums, part of the vBSEO Google/Yahoo Sitemap category; Hello. I'm new to all this sitemap stuff and i've been reading a few of the threads around here and ...

Go Back   vBulletin SEO Forums > vBSEO Google/Yahoo Sitemap > Troubleshooting

Enhancing 80 million pages.

Register FAQ Members List Social Groups Calendar Search Today's Posts Mark Forums Read
  #1  
Old 10-03-2007, 03:44 PM
Member
 
Real Name: Patrick
Join Date: Sep 2007
Posts: 75
Can I get help testing to make sure

Hello. I'm new to all this sitemap stuff and i've been reading a few of the threads around here and well, though somewhat confused because of different suggestions for/from diffrent people, i was hoping to find out if my settings are all correct for my setup.

first. i want to clarify that my forum is in a subdirectory
Legion of Angels Forums

with that. here is my .htaccess file within that same directory

Quote:
# Comment the following line (add '#' at the beginning)
# to disable mod_rewrite functions.
# Please note: you still need to disable the hack in
# the vBSEO control panel to stop url rewrites.
RewriteEngine On
# Some servers require the Rewritebase directive to be
# enabled (remove '#' at the beginning to activate)
# Please note: when enabled, you must include the path
# to your root vB folder (i.e. RewriteBase /forums)
RewriteBase /forum
RewriteCond %{HTTP_HOST} !^Legion of Angels
RewriteRule (.*) http://www.legionofangels.net/forum/$1 [L,R=301]
RewriteRule ^sitemap(\.txt(\.gz)?)$ forum/vbseo_sitemap/vbseo_getsitemap.php?sitemap=urllist$1 [L]
RewriteRule ^((urllist|sitemap_).*\.(xml|txt)(\.gz)?)$ forum/vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
RewriteCond %{QUERY_STRING} !vbseourl=
RewriteCond %{REQUEST_URI} !(admincp/|modcp/|chat|cron)
RewriteRule ^(.*\.php)$ vbseo.php?vbseourl=$1 [L,QSA]
RewriteCond %{REQUEST_FILENAME} !\.(jpg|gif)$
RewriteRule ^(archive/.*)$ vbseo.php?vbseourl=$1 [L,QSA]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteCond %{REQUEST_FILENAME} !^(admincp|modcp|clientscript|cpstyles|images)/
RewriteRule ^(.+)$ vbseo.php?vbseourl=$1 [L,QSA]
i mofidied 1 line to match that of a suggestion in another thread i found regarding robots.txt that mentioned that i should add forum/ over here

Quote:
RewriteRule ^((urllist|sitemap_).*\.(xml|txt)(\.gz)?)$ forum/vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
i also added an extra line i noticed he had just for the heck of it that wasn't in the original vbseo .htaccess

Quote:
RewriteRule ^sitemap(\.txt(\.gz)?)$ forum/vbseo_sitemap/vbseo_getsitemap.php?sitemap=urllist$1 [L]
still not sure most of this does but if it works i dont' mind.


with that. i am just hoping someone could confirm everything is correct for me. i would greatly appreciate it.


with that. i would like to ask the following related questions.


1. when i click on the following link http://www.legionofangels.net/forum/sitemap_index.xml.gz from within the seoreports page within the admincp. what should i get? cause i get a blank page.

2. when i MANUALLY submit the above "sitemap" to google using their webmaster tools, which btw, does not exist in the ftp directory, what's supposed to happen is google reads the .htaccess file first and then goes to the real location that's within vbseo_sitemap/data?

because when i submit it manually, it says there is an error and gives me this error

Quote:
Network unreachable: Network unreachable
We encountered an error while trying to access your Sitemap. Please ensure your Sitemap follows our guidelines and can be accessed at the location you provided and then resubmit
3. i double checked permissions and have the following:

data folder is 777.
hits folder is 777
all the *.gz files (3 total) are 666
all the log files are 666
index.php is 644
.htaccess (the one that says deny all) is 644
and downloads.dat is 644

are these all correct?


4. what do you recommend i have for a .htaccess file for my root directory (not forum) if anything at all?

5. if i have a sitemap for my forums with the help of this, do i still need one, or is one recommended for my main page?

main page: Legion of Angels
forum: Legion of Angels Forums

5.a. and if i do, does the main page one still have to go as far as the forum? or can i make one that only stays within root so it's smaller? cause i tried using this site Create your Google Sitemap Online - XML Sitemaps and that thing took forever and i decided to just quit and not use it. it was scanning like every single forum page i have. O_o

6. which file is scanned first by crawlers, robots or .htaccess or sitemap?

6.a. cause if it's robots. does that mean i should have made a robots file BEFORE making a sitemap so that the sitemap generator skips over the the files i specified in robots? O_o

6.b. if so. could someone list for me the most common useless pages i can exclude from my forum? or any directory you think i should exclude that might pose a security risk? i'd very much appreciate that as i would like to completely redo my robots.txt especially since i might have to adjust it for the new url's that vbseo made which are nice and much shorter.


7. i only need ONE robots.txt file right? and it always goes to root right? (not forum root)

8. but i can have multiple .htaccess? do i have to or just if i wanted to? (one for root, one for forum root?)


9. i think i had more q's but i forgot. i'm sorry for having so many. i tried to find the answers to most of these in older threads but i kept getting mixed suggestions. some would say something. and others would have yet more to say. not neccisrily conflicting advice, but maybe. and i didn't know which to believe/follow.


thank you very much in advanced. i just wnna get rid of the doubts in my head so i can start making real progress, and not have so many questions next time i get stuck.

thanks again.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #2  
Old 10-04-2007, 12:51 PM
Michael Biddle's Avatar
vBSEO Staff
vBSEO Total Customer Support
 
Real Name: Michael Biddle
Join Date: Jan 2007
Location: Southern California
Posts: 2,898
Blog Entries: 5
In your htaccess you have this:

RewriteRule ^((urllist|sitemap_).*\.(xml|txt)(\.gz)?)$ forum/vbseo_sitemap/vbseo_getsitemap.php?sitemap=$ 1 [L]

take the forum off of that line.

RewriteRule ^((urllist|sitemap_).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$ 1 [L]
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #3  
Old 10-04-2007, 06:38 PM
Member
 
Real Name: Patrick
Join Date: Sep 2007
Posts: 75
done and done! thanks.


/me will await the answers for the other q's.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #4  
Old 10-04-2007, 07:31 PM
Michael Biddle's Avatar
vBSEO Staff
vBSEO Total Customer Support
 
Real Name: Michael Biddle
Join Date: Jan 2007
Location: Southern California
Posts: 2,898
Blog Entries: 5
Quote:
Originally Posted by legionofangels View Post
1. when i click on the following link http://www.legionofangels.net/forum/...p_index.xml.gz from within the seoreports page within the admincp. what should i get? cause i get a blank page.

2. when i MANUALLY submit the above "sitemap" to google using their webmaster tools, which btw, does not exist in the ftp directory, what's supposed to happen is google reads the .htaccess file first and then goes to the real location that's within vbseo_sitemap/data?

because when i submit it manually, it says there is an error and gives me this error



3. i double checked permissions and have the following:

data folder is 777.
hits folder is 777
all the *.gz files (3 total) are 666
all the log files are 666
index.php is 644
.htaccess (the one that says deny all) is 644
and downloads.dat is 644

are these all correct?


4. what do you recommend i have for a .htaccess file for my root directory (not forum) if anything at all?

5. if i have a sitemap for my forums with the help of this, do i still need one, or is one recommended for my main page?

main page: Legion of Angels
forum: Legion of Angels Forums

5.a. and if i do, does the main page one still have to go as far as the forum? or can i make one that only stays within root so it's smaller? cause i tried using this site Create your Google Sitemap Online - XML Sitemaps and that thing took forever and i decided to just quit and not use it. it was scanning like every single forum page i have. O_o

6. which file is scanned first by crawlers, robots or .htaccess or sitemap?

6.a. cause if it's robots. does that mean i should have made a robots file BEFORE making a sitemap so that the sitemap generator skips over the the files i specified in robots? O_o

6.b. if so. could someone list for me the most common useless pages i can exclude from my forum? or any directory you think i should exclude that might pose a security risk? i'd very much appreciate that as i would like to completely redo my robots.txt especially since i might have to adjust it for the new url's that vbseo made which are nice and much shorter.


7. i only need ONE robots.txt file right? and it always goes to root right? (not forum root)

8. but i can have multiple .htaccess? do i have to or just if i wanted to? (one for root, one for forum root?)


9. i think i had more q's but i forgot. i'm sorry for having so many. i tried to find the answers to most of these in older threads but i kept getting mixed suggestions. some would say something. and others would have yet more to say. not neccisrily conflicting advice, but maybe. and i didn't know which to believe/follow.


thank you very much in advanced. i just wnna get rid of the doubts in my head so i can start making real progress, and not have so many questions next time i get stuck.

thanks again.
1) I answered
2) What I told you should have fixed that
3) What I told you should have fixed that
4) I would add make your htaccess have at least this in it:

Code:
RewriteCond %{HTTP_HOST} !^yoursite.com
RewriteRule (.*) http://www.yoursite.com/$1 [L,R=301]
5) Would be good if you had a sitemap also for your main site. Reason being it threads http://mysite.com and http://www.mysite.com differently

5a) Stays within the root as long as you run the vbseo sitemap generator I believe

6) Not sure

7) Not sure on, I just use 1 directory, but assuming you should have 1 in main domain and 1 in forums

8) 1 .htaccess per folder. Should only really need 2 IMO

9) Yes alot of questions...lol
__________________
Michael Biddle / Crawlability Inc.
vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

vBSEO Google Sitemap Generator - Version 2.2 Released Mandatory Upgrade for vBSEO 3.2.0 GOLD

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #5  
Old 10-05-2007, 04:36 AM
Member
 
Real Name: Patrick
Join Date: Sep 2007
Posts: 75
ownage. gotta admit. didn't even test the link but i'm glad that little fix will fix most everything. and now that i am more reassured with the importance of those files, i don't have to worry so much anymore.

somtiems reading things here makes me think certain things are too important to neglect. and i hate worrying about it. so i needed to know "well, if they're so important, what about this and that? and what if i have 2? what should it have?" and so on and so forth.

well i'm less worried then. i could prolly just leave everything the way it is i guess. on no wait. i forgot i should prolly look over my robots file. i think someone posted theirs once. i'll prolly just copy them. O_o

thanks again. really appreciate it.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads

Thread Thread Starter Forum Replies Last Post
[HOW-TO] Make your Welcome Headers an image! libertylounge Template Modifications 98 10-18-2008 11:09 PM
Suggestion: make a special sitemap for sticky threads and important topics dutchbb Feature Requests 9 07-15-2006 12:54 PM


All times are GMT -4. The time now is 07:19 AM.


Powered by vBulletin Version 3.8.0 Beta 3
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
SEO by vBSEO 3.2.5 ©2008, Crawlability, Inc.