Google spiders my staff area

Bonus Paradise · #1 06-21-2008, 04:12 AM

I see google is trying to spider my staff area
I see also they getting the no permission message.
but still I dont like them to be there, lol

In Vbulletin Options - vBSEO Google/Yahoo Sitemap Generator

I see this ....
Excluded Forums List

There I have added 5
which is the ID of my whole staff category
but how i remember i did later than when I generated my sitemap
Is this the reason why google still find this links?

Will this be solved soon,
does the sitemap then update and this links for Staff are then not anymore there?

Another question,
If google try to spider now, ok the get no permission
will the still index maybe the title of posts?
hope not.

Please let me know what I have to do

Thank you very much

Marina

Oleg Ignatiuk · #2 06-21-2008, 09:16 AM

Are those URLs included in your sitemap?

Bonus Paradise · #3 06-21-2008, 09:19 AM

Quote:

Originally Posted by Oleg Ignatiuk

Are those URLs included in your sitemap?

how am i able to see that Oleg?

well as said already
I did generate the sitemap
and only later i have seen this setting to exclude forums
so I added this exclude forum ID 5
i think 2 or 3 days after I did generate the map.

Bonus Paradise · #4 06-21-2008, 09:33 AM

I try to look here
http://www.bonusparadise.com/forum/sitemap_1.xml.gz

I am there now
just needed way long to load
I will see what I find there

Bonus Paradise · #5 06-21-2008, 09:39 AM

Yes I found some posts there from my staff area
what should i do Oleg?

ty

exmaple:

Code:

 
<url>
<loc>http://www.bonusparadise.com/forum/bingo-banner/92-jackpot-joy-no-usa.html</loc> 
 
<priority>0.58</priority> 
 
<lastmod>2008-06-18T09:44:37+00:00</lastmod> 
 
<changefreq>monthly</changefreq> 
 
</url>

Oleg Ignatiuk · #6 06-21-2008, 10:16 AM

Please try to modify vbseo_sitemap_functions.php file:
FIND:

PHP Code:

  (isset($vboptions['hideprivateforums'])&&!$vboptions['hideprivateforums'])

REPLACE WITH:

PHP Code:

  ($vboptions['hideprivateforums']||!isset($vboptions['hideprivateforums']))

Bonus Paradise · #7 06-21-2008, 11:16 AM

I have done that

this is how it looks now in file

PHP Code:

   AND ($vboptions['hideprivateforums']||!isset($vboptions['hideprivateforums']))  )
   {
    continue;

when and how can i see if this works?
should the urls from sitemap disappear immediatly or how long should i wait to check?

thanks a lot for the effort
you guys are the best!

Oleg Ignatiuk · #8 06-21-2008, 03:29 PM

You should regenerate sitemap manually via vbseo_sitemap/ interface and check that those URLs are not included in sitemap now.

Bonus Paradise · #9 06-21-2008, 04:55 PM

thanks Oleg
I did generate the sitemap again
and i see now after the re generate in that part

Code:

[forumdisplay] forum_id: 1, total threads: 0, pages: 1 [1,411.8Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 2, total threads: 99, pages: 4 [1,424.1Kb mem used] [0s (+0s)].............. 
...............

there is no forum ID which belongs to my staff
so that should be fine then hm?

just checked the sitemap quick
I see no forum posts or urls so far

thanks for the help again

Marina

Oleg Ignatiuk · #10 06-21-2008, 06:33 PM

Yes, it should be fine now then.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Just a quick one ^^ (Google Spiders)	Yours Truly	General Discussion	2	02-29-2008 04:27 PM
Download area ?	sensimilla	Troubleshooting	2	10-22-2007 09:34 AM
Discussion area regarding version 3	Mike	General Discussion	3	06-01-2006 10:55 AM
weeks after google spiders, still old pages in SERPs	Scott Mueller	General Discussion	4	04-24-2006 07:02 PM
This area is password protected.	Greg Watson	Troubleshooting	10	10-30-2005 04:54 PM

SEO

Google spiders my staff area

Google spiders my staff area

Similar Threads