As thread subject above.
Our forums has more than 900,000 threads and if the task/cron re-indexes from scratch every time, we will definitely encounter issues.
Thanks in advance.
This is a discussion on Question: Does the VBSEO Sitemap generator update only changes or re-indexes the entire site on Schedule Task/Cron? within the General Discussion forums, part of the vBSEO Google/Yahoo Sitemap category; As thread subject above. Our forums has more than 900,000 threads and if the task/cron re-indexes from scratch every time, ...
As thread subject above.
Our forums has more than 900,000 threads and if the task/cron re-indexes from scratch every time, we will definitely encounter issues.
Thanks in advance.
Hello Darren ,
We advise to create a cron level on server level for big board. You can check readme.html for more details
Mert Gökçeimam / Crawlability Inc.
vBSEO 3.6.0 Alpha Önizlemesi - Including Like Tree
Unveiling the NEW vBSEO Sitemap Generator 3.0 - available NOW for vBSEO Customers!
Twitter:@Depkac
Personal Blog : Mert Gökçeimam
To answer your question directly, it rebuilds itself entirely every night.
I suggest just including threads and forums only.
My server cracks out my sitemap in about 20 seconds for 150,000 threads, so it should not be that daunting of a task if you have the hardware to generate it.
Brian Cummiskey / Crawlability Inc.
Security vbulletin - Patch Level for all supported versions released!
Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!
Thanks. I used the command line to generate the initial index, and currently only doing threads and member profiles as we encountered DB timeout issues for a couple of forums that contained many threads.
Will incorporate the sitemap generation into the daily cron as per the example given.
I would suggest bypassing member pages. They hold little weight and certainly aren't top landing pages for search results.
Brian Cummiskey / Crawlability Inc.
Security vbulletin - Patch Level for all supported versions released!
Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!