Results 1 to 11 of 11

Sitemap generation problem

This is a discussion on Sitemap generation problem within the Troubleshooting forums, part of the vBSEO Google/Yahoo Sitemap category; I am using search engine sitemap v3.0 made by vbseo and recently I have faced a problem I am having ...

  1. #1
    Member
    Real Name
    ploph1x
    Join Date
    Jul 2008
    Posts
    55
    Liked
    0 times

    Sitemap generation problem

    I am using search engine sitemap v3.0 made by vbseo and recently I have faced a problem I am having with my sitemap files.

    This is how it generates a new sitemap.
    Code:
    [SECTION START] showthread [9,474.6Kb mem used] [127s (+127s)]
    [create sitemap file] filename: sitemap_forum_6.xml.gz, number of urls: 20000 [15,150.0Kb mem used] [137s (+11s)]
    [create sitemap file] filename: sitemap_forum_7.xml.gz, number of urls: 18749 [16,969.7Kb mem used] [165s (+28s)]
    [create sitemap index] filename: sitemap_index.xml.gz, number of sitemaps: 7 [12,580.6Kb mem used] [185s (+20s)]
    Sitemap has been created. Click here to return [12,574.3Kb mem used] [197s (+12s)]
    It doesn't create sitemap_forum_1,2,3,4,5.xml.gz - they are not exist and there are less URLs than what it should be.
    When I try to access my main sitemap file (http://www.x.x/sitemap_index.xml) I receive "Sitemap file not found".

    I can't understand what's causing it.

    Do you have any ideas?
    Best regards,

  2. #2
    vBSEO.com Webmaster Mert Gökçeimam's Avatar
    Real Name
    Lizard King
    Join Date
    Oct 2005
    Location
    Istanbul, Turkey, Turkey
    Posts
    23,111
    Liked
    622 times
    Blog Entries
    4
    Sitemap Generator has a resume feature. If the previous generation attempt was not completed , then it will resume from where it left.
    What is your .htaccess content ?
    Mert Gökçeimam / Crawlability Inc.

    vBSEO 3.6.0 Alpha Önizlemesi - Including Like Tree
    Unveiling the NEW vBSEO Sitemap Generator 3.0 - available NOW for vBSEO Customers!


    Twitter:@Depkac
    Personal Blog : Mert Gökçeimam

  3. #3
    Member
    Real Name
    ploph1x
    Join Date
    Jul 2008
    Posts
    55
    Liked
    0 times
    So how do I generate everything from scratch? I did try to remove all these indexes but problem continues.

    Code:
    # Comment the following line (add '#' at the beginning)
    # to disable mod_rewrite functions.
    # Please note: you still need to disable the hack in
    # the vBSEO control panel to stop url rewrites.
    RewriteEngine On
    
    
    # Some servers require the Rewritebase directive to be
    # enabled (remove '#' at the beginning to activate)
    # Please note: when enabled, you must include the path
    # to your root vB folder (i.e. RewriteBase /forums/)
    RewriteBase /forums/
    
    
    RewriteCond %{HTTP_HOST} !^www\.domain\.com
    RewriteRule (.*) http://www.domain.com/forums/$1 [L,R=301]
    RewriteRule f([0-9]+)-([0-9]+)/? http://www.domain.com/forums/f$1/page$2.html [L,R=301]
    RewriteRule f([0-9]+)/t([0-9]+)-([0-9]+)/? http://www.domain.com/forums/f$1/t$2/page$3.html [L,R=301]
    
    
    RewriteRule ^((urllist|sitemap_).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
    
    
    RewriteCond %{REQUEST_URI} !(apn/|modcp/|cron|vbseo_sitemap)
    RewriteRule ^((archive/)?(.*\.php(/.*)?))$ vbseo.php [L,QSA]
    
    
    RewriteCond %{REQUEST_FILENAME} !-f
    RewriteCond %{REQUEST_FILENAME} !-d
    RewriteCond %{REQUEST_FILENAME} !/(admincp|modcp|clientscript|cpstyles|images)/
    RewriteRule ^(.+)$ vbseo.php [L,QSA]





  4. #4
    vBSEO.com Webmaster Mert Gökçeimam's Avatar
    Real Name
    Lizard King
    Join Date
    Oct 2005
    Location
    Istanbul, Turkey, Turkey
    Posts
    23,111
    Liked
    622 times
    Blog Entries
    4
    You can directly generate sitemap files from vBSEO Sitemap Generator interference domain.com/vbseo_sitemap/
    Mert Gökçeimam / Crawlability Inc.

    vBSEO 3.6.0 Alpha Önizlemesi - Including Like Tree
    Unveiling the NEW vBSEO Sitemap Generator 3.0 - available NOW for vBSEO Customers!


    Twitter:@Depkac
    Personal Blog : Mert Gökçeimam

  5. #5
    Member
    Real Name
    ploph1x
    Join Date
    Jul 2008
    Posts
    55
    Liked
    0 times
    I have already did this, the example in my first post was from there. only last 3 sitemap indexes were generated.
    The others still doesn't exist.

  6. #6
    vBSEO Staff Brian Cummiskey's Avatar
    Real Name
    Brian Cummiskey
    Join Date
    Jul 2009
    Location
    btwn NYC and Boston
    Posts
    12,789
    Liked
    657 times
    Blog Entries
    2
    Are your forums public? The sitemap will only generate urls for threads/etc that are guest-viewable.

  7. #7
    Member
    Real Name
    ploph1x
    Join Date
    Jul 2008
    Posts
    55
    Liked
    0 times
    Almost everything is public, except management forums and these stuff.
    I didn't have this problem in the past.

    *edit*
    Problem solved.

    Sitemap Generator has a resume feature. If the previous generation attempt was not completed , then it will resume from where it left.
    How does it know from where to resume? the reports list.
    Seems like something messed up with these reports, I did move the report logs to another directory and ran the generator.
    Now everything works like a charm.

  8. #8
    vBSEO Staff Brian Cummiskey's Avatar
    Real Name
    Brian Cummiskey
    Join Date
    Jul 2009
    Location
    btwn NYC and Boston
    Posts
    12,789
    Liked
    657 times
    Blog Entries
    2
    It uses the progress.dat file to know where it left off. IF you want to start from the beginning, you should delete this file, along with the xml.gz files in the /data/ folder before re-generating.

  9. #9
    Member
    Real Name
    ploph1x
    Join Date
    Jul 2008
    Posts
    55
    Liked
    0 times
    I don't have that file.

  10. #10
    vBSEO Staff Brian Cummiskey's Avatar
    Real Name
    Brian Cummiskey
    Join Date
    Jul 2009
    Location
    btwn NYC and Boston
    Posts
    12,789
    Liked
    657 times
    Blog Entries
    2
    If there's no progress.dat then it completed correctly (or at least all the way through).

    Please open a ticket with login details for further troubleshooting.

  11. #11
    Member
    Real Name
    ploph1x
    Join Date
    Jul 2008
    Posts
    55
    Liked
    0 times
    Thank you Brian.

Similar Threads

  1. vBulletin 4.x sitemaps generation problem
    By gregoire in forum Troubleshooting
    Replies: 9
    Last Post: 08-04-2011, 03:50 PM
  2. vBulletin 3.x Sitemap generation error..
    By moddis in forum Troubleshooting
    Replies: 8
    Last Post: 12-11-2010, 09:59 AM
  3. Turn off XML Sitemap Generation in vB4?
    By Jesh in forum General Discussion
    Replies: 9
    Last Post: 01-27-2010, 09:37 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •