Spider friendly URLs

For vB 2.0

This little hackette is a quick fix to allow search engine bots to spider your threads.

Although this will allow the bots to index every thread on your site, it will not make the threads 'search engine optimized'. They will see exactly what you see when you visit your site. It simply removes the CGI bits from the URL's which prevents most search engine bots from spidering more than one level deep.

If you want a hack that allows to fully customize how the thread will look to the search engine bot, you should look at Overgrows more complete hack here.

The advantage of this hack over Overgrows is that it does not require htaccess support which can have performance issues. This could also be seen as a disadvantage though as my hack requires that you have mod_rewrite enabled on your Apache Server, whereas Overgrows method should work with just about any web host out there.

Take yer pick

[eva2000]

got a demo/example url for us ?

[fastforward]

Originally posted by eva2000
got a demo/example url for us ?

http://dbforums.com

You can see the forum links on the front page are like :

http://dbforums.com/f5/s



and the threads are like:

http://dbforums.com/t44153/s.html

[Overgrow]

Hey very cool.. I haven't looked at the code yet, but nice job.

One note though: The main point of my hack is getting Google to the archives, not really friendly URLs.. that was just a sidenote. The archiving is what I'm after.

[eva2000]

yeah cool but do normal showthreads and forumdisplay urls still work ?

i.e would a url like http://animeboards.com/forumdisplay.php?s=&forumid=2 still work as well as

http://animeboards.com/f2/s ?

[fastforward]

Originally posted by eva2000
yeah cool but do normal showthreads and forumdisplay urls still work ?

i.e would a url like http://animeboards.com/forumdisplay.php?s=&forumid=2 still work as well as

http://animeboards.com/f2/s ?

hehe. Oh ye of little faith

Yeah they do.

The only urls that are trapped by the mod_rewrite directives are ones that match one of these three expressions:

^/f([0-9]+)/s([^/]+?)$
^/t([0-9]+)/s([^/]+?)\.html$
^/s([^/])+?/$

ie.
/f234/s or /f234/s345345detr3
/t2343/s.html or /t2343/s435345.html
/s/ or /s435345345dfsdf/

Actually I need to clarify in the docs that this assumes your forums are in the web root. Those directives should be prefixed with /forums/ or wherever if your vB is installed elsewhere.

[eva2000]

cool.. yet another hack i'm gonna add hehe

[eva2000]

oh wait any problems you can see running both overgrow's search engine spidering hack and yours together ? i also use htacess to use mod_rewrite to prevent hot linking of my forum images

[fastforward]

Originally posted by eva2000
oh wait any problems you can see running both overgrow's search engine spidering hack and yours together ? i also use htacess to use mod_rewrite to prevent hot linking of my forum images

No problems at all. I just installed Overgrows

http://dbforums.com/archive/

I did make one change to Overgrows though so that I wouldn't need to use .htaccess files. I deleted the .htaccess and added this to my httpd.conf:

RewriteRule ^/archive/.* /archive/index.php [L]

But either method will work.

[eva2000]

Originally posted by fastforward

No problems at all. I just installed Overgrows

http://dbforums.com/archive/

I did make one change to Overgrows though so that I wouldn't need to use .htaccess files. I deleted the .htaccess and added this to my httpd.conf:

RewriteRule ^/archive/.* /archive/index.php [L]

But either method will work.

okay great then