mod_rewrite errors creating over 200mb of error logs daily!

Hi All,

I am running vbulletin 4.1.8 with the latest version of vbSEO. Currently the site was recently migrated and appears to be running fine on a VPS based on CentOS.

I noticed the log files when from the last week, Apache becomes unresponsive every 3 days or so and I have to restart it.

My error log shows:

Code:

[Tue Nov 22 12:31:42 2011] [warn] RewriteOptions: MaxRedirects option has been removed in favor of the global LimitInternalRecursion directive and will be ignored.
[Tue Nov 22 12:31:43 2011] [warn] RewriteOptions: MaxRedirects option has been removed in favor of the global LimitInternalRecursion directive and will be ignored.
[Tue Nov 22 12:31:43 2011] [warn] RewriteOptions: MaxRedirects option has been removed in favor of the global LimitInternalRecursion directive and will be ignored.

So to get more info I added the following two lines in my httpd.conf file

Code:

ReWriteLog "/var/log/httpd/rewrite_log"
ReWriteLogLevel 1

This log is also putting out almost 200mb a day now!

Code:

66.249.72.97 - - [22/Nov/2011:12:34:31 --0500] [www.teamfiat.co.in/sid#2ab0bf959d70][rid#2ab0bfe9d5b0/initial/redir#1] (1) [perdir /var/www/html/forum/] initial URL equal rewritten URL: /var/www/html/forum/vbseo.php [IGNORING REWRITE]
65.52.108.68 - - [22/Nov/2011:12:34:32 --0500] [www.teamfiat.co.in/sid#2ab0bf959d70][rid#2ab0bfe9c960/initial] (1) [perdir /var/www/html/forum/] internal redirect with /vbseo.php [INTERNAL REDIRECT]
65.52.108.68 - - [22/Nov/2011:12:34:32 --0500] [www.teamfiat.co.in/sid#2ab0bf959d70][rid#2ab0bfe9b620/initial/redir#1] (1) [perdir /var/www/html/forum/] initial URL equal rewritten URL: /var/www/html/forum/vbseo.php [IGNORING REWRITE]
65.52.108.68 - - [22/Nov/2011:12:34:35 --0500] [www.teamfiat.co.in/sid#2ab0bf959d70][rid#2ab0c044b4f0/initial] (1) [perdir /var/www/html/forum/] internal redirect with /vbseo.php [INTERNAL REDIRECT]
65.52.108.68 - - [22/Nov/2011:12:34:35 --0500] [www.teamfiat.co.in/sid#2ab0bf959d70][rid#2ab0bfe9b748/initial/redir#1] (1) [perdir /var/www/html/forum/] initial URL equal rewritten URL: /var/www/html/forum/vbseo.php [IGNORING REWRITE]
65.52.108.68 - - [22/Nov/2011:12:34:37 --0500] [www.teamfiat.co.in/sid#2ab0bf959d70][rid#2ab0bfe98940/initial] (1) [perdir /var/www/html/forum/] internal redirect with /vbseo.php [INTERNAL REDIRECT]
65.52.108.68 - - [22/Nov/2011:12:34:37 --0500] [www.teamfiat.co.in/sid#2ab0bf959d70][rid#2ab0bfea4500/initial/redir#1] (1) [perdir /var/www/html/forum/] initial URL equal rewritten URL: /var/www/html/forum/vbseo.php [IGNORING REWRITE]

My htaccess file is the default file which came with vbseo

Code:

Options +FollowSymlinks


RewriteEngine On
RewriteOptions MaxRedirects=10




# Some servers require the Rewritebase directive to be
# enabled (remove '#' at the beginning to activate)
# Please note: when enabled, you must include the path
# to your root vB folder (i.e. RewriteBase /forums/)
#RewriteBase /forum/


#RewriteCond %{HTTP_HOST} !^www\.yourdomain\.com
#RewriteRule (.*) http://www.yourdomain.com/forums/$1 [L,R=301]


RewriteRule ^((urllist|sitemap_).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]


RewriteCond %{REQUEST_URI} !(admincp/|modcp/|cron|vbseo_sitemap|api\.php)
RewriteRule ^((archive/)?(.*\.php(/.*)?))$ vbseo.php [L,QSA]


RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteCond %{REQUEST_FILENAME} !/(admincp|modcp|clientscript|cpstyles|images)/
RewriteRule ^(.+)$ vbseo.php [L,QSA]

The site Team Fiat India appear to be working fine except for the Apache dying every few days.

Any help/ideas would be greatly appreciated!

Thanks in advance!

Amogh

Hello,

could you please try to match the date/time/IP from the error log with access log to find which URL causes mod_rewrite recursion?

Error log is between 07:34:45 to 07:34:47

Error_Log

Code:

[Wed Nov 23 07:34:45 2011] [warn] RewriteOptions: MaxRedirects option has been removed in favor of the global LimitInternalRecursion directive and will be ignored.[Wed Nov 23 07:34:45 2011] [warn] RewriteOptions: MaxRedirects option has been removed in favor of the global LimitInternalRecursion directive and will be ignored.
[Wed Nov 23 07:34:45 2011] [warn] RewriteOptions: MaxRedirects option has been removed in favor of the global LimitInternalRecursion directive and will be ignored.
[Wed Nov 23 07:34:45 2011] [warn] RewriteOptions: MaxRedirects option has been removed in favor of the global LimitInternalRecursion directive and will be ignored.
[Wed Nov 23 07:34:46 2011] [warn] RewriteOptions: MaxRedirects option has been removed in favor of the global LimitInternalRecursion directive and will be ignored.
[Wed Nov 23 07:34:46 2011] [warn] RewriteOptions: MaxRedirects option has been removed in favor of the global LimitInternalRecursion directive and will be ignored.
[Wed Nov 23 07:34:46 2011] [warn] RewriteOptions: MaxRedirects option has been removed in favor of the global LimitInternalRecursion directive and will be ignored.
[Wed Nov 23 07:34:46 2011] [warn] RewriteOptions: MaxRedirects option has been removed in favor of the global LimitInternalRecursion directive and will be ignored.
[Wed Nov 23 07:34:46 2011] [warn] RewriteOptions: MaxRedirects option has been removed in favor of the global LimitInternalRecursion directive and will be ignored.
[Wed Nov 23 07:34:47 2011] [warn] RewriteOptions: MaxRedirects option has been removed in favor of the global LimitInternalRecursion directive and will be ignored.
[Wed Nov 23 07:34:47 2011] [warn] RewriteOptions: MaxRedirects option has been removed in favor of the global LimitInternalRecursion directive and will be ignored.
[Wed Nov 23 07:34:47 2011] [warn] RewriteOptions: MaxRedirects option has been removed in favor of the global LimitInternalRecursion directive and will be ignored.
[Wed Nov 23 07:34:47 2011] [warn] RewriteOptions: MaxRedirects option has been removed in favor of the global LimitInternalRecursion directive and will be ignored.
[Wed Nov 23 07:34:47 2011] [warn] RewriteOptions: MaxRedirects option has been removed in favor of the global LimitInternalRecursion directive and will be ignored.

Rewrite_log

Code:

203.99.40.226 - - [23/Nov/2011:07:34:45 --0500] [www.teamfiat.co.in/sid#2ab0bf959d70][rid#2ab0bfe98940/initial] (1) [perdir /var/www/html/forum/] internal redirect with /vbseo.php [INTERNAL REDIRECT]
203.99.40.226 - - [23/Nov/2011:07:34:45 --0500] [www.teamfiat.co.in/sid#2ab0bf959d70][rid#2ab0c03ddd90/initial/redir#1] (1) [perdir /var/www/html/forum/] initial URL equal rewritten URL: /var/www/html/forum/vbseo.php [IGNORING REWRITE]
119.82.81.159 - - [23/Nov/2011:07:34:45 --0500] [www.teamfiat.co.in/sid#2ab0bf959d70][rid#2ab0bfea59a0/initial] (1) [perdir /var/www/html/forum/] internal redirect with /vbseo.php [INTERNAL REDIRECT]
119.82.81.159 - - [23/Nov/2011:07:34:45 --0500] [www.teamfiat.co.in/sid#2ab0bf959d70][rid#2ab0bfe9f640/initial/redir#1] (1) [perdir /var/www/html/forum/] initial URL equal rewritten URL: /var/www/html/forum/vbseo.php [IGNORING REWRITE]
119.82.81.159 - - [23/Nov/2011:07:34:45 --0500] [www.teamfiat.co.in/sid#2ab0bf959d70][rid#2ab0bfe9a950/initial] (1) [perdir /var/www/html/forum/] pass through /var/www/html/forum/images/misc/bookmarksite_delicious.gif
119.82.81.159 - - [23/Nov/2011:07:34:45 --0500] [www.teamfiat.co.in/sid#2ab0bf959d70][rid#2ab0bfe9c960/initial] (1) [perdir /var/www/html/forum/] pass through /var/www/html/forum/images/misc/bookmarksite_digg.gif
119.82.81.159 - - [23/Nov/2011:07:34:45 --0500] [www.teamfiat.co.in/sid#2ab0bf959d70][rid#2ab0c08ab9f0/initial] (1) [perdir /var/www/html/forum/] pass through /var/www/html/forum/images/misc/bookmarksite_stumbleupon.gif
115.248.154.196 - - [23/Nov/2011:07:34:45 --0500] [www.teamfiat.co.in/sid#2ab0bf959d70][rid#2ab0bfe9c960/initial] (1) [perdir /var/www/html/forum/] internal redirect with /vbseo.php [INTERNAL REDIRECT]
115.248.154.196 - - [23/Nov/2011:07:34:45 --0500] [www.teamfiat.co.in/sid#2ab0bf959d70][rid#2ab0bfea4fa8/initial/redir#1] (1) [perdir /var/www/html/forum/] initial URL equal rewritten URL: /var/www/html/forum/vbseo.php [IGNORING REWRITE]
119.82.81.159 - - [23/Nov/2011:07:34:45 --0500] [www.teamfiat.co.in/sid#2ab0bf959d70][rid#2ab0bfea1980/initial] (1) [perdir /var/www/html/forum/] pass through /var/www/html/forum/images/misc/bookmarksite_google.gif
119.82.81.159 - - [23/Nov/2011:07:34:46 --0500] [www.teamfiat.co.in/sid#2ab0bf959d70][rid#2ab0bfe98940/initial] (1) [perdir /var/www/html/forum/] pass through /var/www/html/forum/images/buttons/collapse_40b.png
115.111.90.114 - - [23/Nov/2011:07:34:46 --0500] [www.teamfiat.co.in/sid#2ab0bf959d70][rid#2ab0bfe9c960/initial] (1) [perdir /var/www/html/forum/] internal redirect with /vbseo.php [INTERNAL REDIRECT]
115.111.90.114 - - [23/Nov/2011:07:34:46 --0500] [www.teamfiat.co.in/sid#2ab0bf959d70][rid#2ab0bfea5e08/initial/redir#1] (1) [perdir /var/www/html/forum/] initial URL equal rewritten URL: /var/www/html/forum/vbseo.php [IGNORING REWRITE]
119.82.81.159 - - [23/Nov/2011:07:34:46 --0500] [www.teamfiat.co.in/sid#2ab0bf959d70][rid#2ab0bfcecd10/initial] (1) [perdir /var/www/html/forum/] pass through /var/www/html/forum/images/buttons/newbtn_middle.png
119.82.81.159 - - [23/Nov/2011:07:34:46 --0500] [www.teamfiat.co.in/sid#2ab0bf959d70][rid#2ab0bfea1980/initial] (1) [perdir /var/www/html/forum/] pass through /var/www/html/forum/images/gradients/selected-tab-gradient-with-top-alpha.png
119.82.81.159 - - [23/Nov/2011:07:34:46 --0500] [www.teamfiat.co.in/sid#2ab0bf959d70][rid#2ab0c08ab9f0/initial] (1) [perdir /var/www/html/forum/] pass through /var/www/html/forum/images/misc/navbit-arrow-right.png
119.82.81.159 - - [23/Nov/2011:07:34:47 --0500] [www.teamfiat.co.in/sid#2ab0bf959d70][rid#2ab0bfe9a950/initial] (1) [perdir /var/www/html/forum/] pass through /var/www/html/forum/images/misc/arrow.png
119.82.81.159 - - [23/Nov/2011:07:34:47 --0500] [www.teamfiat.co.in/sid#2ab0bf959d70][rid#2ab0bfea1980/initial] (1) [perdir /var/www/html/forum/] pass through /var/www/html/forum/images/misc/black_downward_arrow.png
203.99.40.226 - - [23/Nov/2011:07:34:47 --0500] [www.teamfiat.co.in/sid#2ab0bf959d70][rid#2ab0bfe9c960/initial] (1) [perdir /var/www/html/forum/] pass through /var/www/html/forum/images/smilies/smiley-laughing025.gif
119.82.81.159 - - [23/Nov/2011:07:34:47 --0500] [www.teamfiat.co.in/sid#2ab0bf959d70][rid#2ab0bfea1980/initial] (1) [perdir /var/www/html/forum/] pass through /var/www/html/forum/images/statusicon/post_old.png
119.82.81.159 - - [23/Nov/2011:07:34:47 --0500] [www.teamfiat.co.in/sid#2ab0bf959d70][rid#2ab0bfea1980/initial] (1) [perdir /var/www/html/forum/] pass through /var/www/html/forum/vbseo/resources/images/forum/vbseo_like.png

I mean the *access log*, not the error or rewrite log though (that where you can get the requested URL details).

oops! missed that!

Access log

Code:

116.197.178.83 - - [24/Nov/2011:02:59:55 -0500] "POST /ajax.php?do=autosave HTTP/1.1" 200 57 "http://www.teamfiat.co.in/private.php?do=showpm&pmid=14231" "Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729; .NET4.0C; .NET4.0E)"121.244.165.252 - - [24/Nov/2011:02:59:55 -0500] "GET /images/smilies/icon_e_biggrin.gif HTTP/1.1" 200 627 "http://www.teamfiat.co.in/punto-1-3-mjd/691-my-red-punto-7.html" "Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; WOW64; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; .NET CLR 1.1.4322; MS-RTC LM 8; .NET4.0C; .NET4.0E)"
121.244.165.252 - - [24/Nov/2011:02:59:55 -0500] "GET /images/attach/jpg.gif HTTP/1.1" 200 183 "http://www.teamfiat.co.in/punto-1-3-mjd/691-my-red-punto-7.html" "Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; WOW64; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; .NET CLR 1.1.4322; MS-RTC LM 8; .NET4.0C; .NET4.0E)"
121.244.165.252 - - [24/Nov/2011:02:59:56 -0500] "GET /avatars/varunrtr.gif?dateline=1316954972 HTTP/1.1" 200 1618 "http://www.teamfiat.co.in/punto-1-3-mjd/691-my-red-punto-7.html" "Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; WOW64; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; .NET CLR 1.1.4322; MS-RTC LM 8; .NET4.0C; .NET4.0E)"
121.244.165.252 - - [24/Nov/2011:02:59:56 -0500] "GET /images/smilies/icon_cool.gif HTTP/1.1" 200 408 "http://www.teamfiat.co.in/punto-1-3-mjd/691-my-red-punto-7.html" "Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; WOW64; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; .NET CLR 1.1.4322; MS-RTC LM 8; .NET4.0C; .NET4.0E)"
121.244.165.252 - - [24/Nov/2011:02:59:55 -0500] "GET /avatars/royj.gif?dateline=1302423796 HTTP/1.1" 200 15133 "http://www.teamfiat.co.in/punto-1-3-mjd/691-my-red-punto-7.html" "Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; WOW64; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; .NET CLR 1.1.4322; MS-RTC LM 8; .NET4.0C; .NET4.0E)"
27.4.176.155 - - [24/Nov/2011:02:59:57 -0500] "GET /punto-1-3-mjd/645-performance-punto-mjd-versus-others-9.html HTTP/1.1" 200 16747 "http://www.teamfiat.co.in/punto-1-3-mjd/645-performance-punto-mjd-versus-others-3.html" "Mozilla/5.0 (Windows NT 5.1) AppleWebKit/535.1 (KHTML, like Gecko) Chrome/14.0.835.202 Safari/535.1"
66.249.72.97 - - [24/Nov/2011:02:59:59 -0500] "GET /images/statusicon/thread_moved-30.png HTTP/1.1" 200 2714 "http://www.teamfiat.co.in/team-fiat-stickers/" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.97 - - [24/Nov/2011:03:00:00 -0500] "GET /forum/showthread.php?1295-Rear-view-camera HTTP/1.1" 301 - "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

Error log

Code:

[Thu Nov 24 02:59:55 2011] [warn] RewriteOptions: MaxRedirects option has been removed in favor of the global LimitInternalRecursion directive and will be ignored.
[Thu Nov 24 02:59:55 2011] [warn] RewriteOptions: MaxRedirects option has been removed in favor of the global LimitInternalRecursion directive and will be ignored.
[Thu Nov 24 02:59:55 2011] [warn] RewriteOptions: MaxRedirects option has been removed in favor of the global LimitInternalRecursion directive and will be ignored.
[Thu Nov 24 02:59:55 2011] [warn] RewriteOptions: MaxRedirects option has been removed in favor of the global LimitInternalRecursion directive and will be ignored.
[Thu Nov 24 02:59:56 2011] [warn] RewriteOptions: MaxRedirects option has been removed in favor of the global LimitInternalRecursion directive and will be ignored.
[Thu Nov 24 02:59:56 2011] [warn] RewriteOptions: MaxRedirects option has been removed in favor of the global LimitInternalRecursion directive and will be ignored.
[Thu Nov 24 02:59:57 2011] [warn] RewriteOptions: MaxRedirects option has been removed in favor of the global LimitInternalRecursion directive and will be ignored.
[Thu Nov 24 02:59:59 2011] [warn] RewriteOptions: MaxRedirects option has been removed in favor of the global LimitInternalRecursion directive and will be ignored.
[Thu Nov 24 03:00:00 2011] [warn] RewriteOptions: MaxRedirects option has been removed in favor of the global LimitInternalRecursion directive and will be ignored.

Appears that all requests are causing the problem

Actually that's just a configuration issue - you should remove "MaxRedirects " setting from apache config since it's not used anymore.

Originally Posted by Oleg Ignatiuk

Actually that's just a configuration issue - you should remove "MaxRedirects " setting from apache config since it's not used anymore.

There is no MaxRedirects in my httpd.conf file. Do I have to add it with a 0 value or something?

Thanks for all the help!

You have it defined in .htaccess:
RewriteOptions MaxRedirects=10