KURTZ

Originally Posted by KURTZ

thanks Brian just tested this:

Code:

# Allow Archive.org to save snapshots of everything
User-agent: ia_archiver
Allow: /

# Tame yahoo... it tends to eat a ton of resources without a delay
User-agent: Slurp
Crawl-delay: 60


#list individual pages and files here that all bots should ignore, as well as group extentions.
#If you re-write everything to .html, you can disallow *.php, but note that if you don't have a CRR

...

Originally Posted by KURTZ

Code:

// Calendar
'calendar\.php$' => 'calendar/'
'^calendar\.php\?c=1$' => 'calendar/'
'^calendar\.php\?(c=1&)?do=(display.+?)(&year=)?$' => 'calendar/$2/[NF]'
'calendar\.php\?(c=1&)?nojs=1' => 'calendar/nojs/[NF]'
'calendar\.php\?(c=1&)?do=(display.+?)&nojs=1' => 'calendar/$2/nojs/[NF]'
'calendar\.php\?(c=1&)?week=(\d+)&nojs=1' => 'calendar/week-$2/nojs/[NF]'
'calendar\.php\?(c=1&)?month=(\d+)&year=(\d+)&nojs=1'

...