Timing Out

tylercruz · #1 09-27-2007, 08:52 PM

I just installed the Sitemap plugin on one of my sites, and when I click: Run Sitemap Generator, it tries for a long time (I can see the blue progress bar at the bottom of my browser), and then times out after 5-minutes or so.

I have this plugin running fine on 3 of my other forums, but this forum is a lot larger than the rest at close to 200,000 posts. I assume this is why it's timing out... do I need to raise the timeout in PHP or something? Also, will is take this long to rebuild the sitemap each time it runs? I'm worried that it might hog down my server once a night or whenever it is set to run.

Anyhow, I'm having difficulties in building my sitemap file, hopefully Google won't be penelizing me until we figure something out?

tylercruz · #2 09-27-2007, 09:28 PM

I just tried to root this via SSH but am having difficulties with that too:

[root@trinity vbseo_sitemap]# ./vbseo_sitemap.php
-bash: ./vbseo_sitemap.php: Permission denied

Mert Gökçeimam · #3 09-27-2007, 09:42 PM

Hello Tyler ,

Please first change the following setting @ vBSEO Google/Yahoo Sitemap Generator setting via admincp Delay Execution After Each Sitemap File to 60
then try to manually run the sitemap generator from domain.com/forum/vbseo_sitemap/ interferance. If it timeouts please rerun the sitemap from the same place.

tylercruz · #4 09-27-2007, 09:59 PM

Hi Mert,

I just changed Delay Execution After Each Sitemap File to 60 and tried running it again, but after about 15-minutes it timed out again. And I'm unsure what you mean by "If it timeouts please rerun the sitemap from the same place."

Mert Gökçeimam · #5 09-28-2007, 07:25 AM

vBSEO Sitemap has a resume feature. If you re run the sitemap again it will resume where it timed out.

tylercruz · #6 09-28-2007, 04:52 PM

Hi,

Okay, so I clicked the Run Sitemap Generator button again, and it timed out after 10-minutes or so. Then I went back and ran it again, and it timed out again.

Now what?

Oleg Ignatiuk · #7 09-28-2007, 05:33 PM

Do you see any output when running it manually?

tylercruz · #8 09-29-2007, 12:54 AM

When I tried to run it manually yesterday, as posted a few posts above, this is what I got:

[root@trinity vbseo_sitemap]# ./vbseo_sitemap.php
-bash: ./vbseo_sitemap.php: Permission denied

tylercruz · #9 09-29-2007, 01:00 AM

Okay, I just ran: php vbseo_sitemap.php and it worked. I always thought I had to use ./file.php to execute a script... mind explaining why I had to use php here instead?

Oleg Ignatiuk · #10 09-29-2007, 06:04 AM

It's a regular way to execute php file ("php file.php"), you should only run shell scripts/executable binaries with "./file.ext".

tylercruz · #11 09-29-2007, 11:37 PM

Ah, shows what I know

I can now access the sitemap after issuing the command, but I have a few questions for you:

1. Am I right to assume that the plugin will continue to generate/rewrite the sitemaps via serverside, and that I won't have to manually update this myself? I only ask this since I had to invoke this command through the server directly (SSH) and not through the browser.

2. It took a total of 23 minutes to run the script (1,714s). Is this normal? Again, the forum I'm running it on has 200,000 posts. Note that I set the plugin options to include old URLs too since it was recommended until the new URLs are indexed, so I plan on setting it to "No" in a couple months.

3. The script created a total of 24 files, at 20,000 URLs each... 480,000. Does that make sense? The only thing I can think of is 200,000 posts * 2 (Old and New URLs) I presume?

Thanks!

gedsta · #12 09-30-2007, 06:10 AM

Quote:

2. It took a total of 23 minutes to run the script (1,714s). Is this normal? Again, the forum I'm running it on has 200,000 posts. Note that I set the plugin options to include old URLs too since it was recommended until the new URLs are indexed, so I plan on setting it to "No" in a couple months.

When you change it to no, this figure will greatly reduce.

Quote:

3. The script created a total of 24 files, at 20,000 URLs each... 480,000. Does that make sense? The only thing I can think of is 200,000 posts * 2 (Old and New URLs) I presume?

As above, pretty much yes.

tylercruz · #13 10-08-2007, 05:01 AM

Ugh :(

I just checked my Sitemap area in Google and it's getting errors:

Unsupported file format
Your Sitemap does not appear to be in a supported format. Please ensure it meets our Sitemap guidelines and resubmit.

Is this going to mess up my SEO since Google won't be crawling me anymore? Should I just remove this from my site because I'm having great difficulty...

briansol · #14 10-08-2007, 12:02 PM

i have 850,000 posts, and the sitemap takes about 10 seconds to run.

something else is wrong i think...

Oleg Ignatiuk · #15 10-08-2007, 06:44 PM

Replied to your support ticket.