vbSpiderFriend - Search Engine Friendliness

I am tired of my 200,000 posts not being listed in Google. I was inspired by phpbuilder.com this morning and I wrote:

vbSpiderFriend - the search engine indexer for all of your posts

Purpose: Allow search engine spiders to crawl a linked list of all of your posts.

Project Requirements:

-Friendly URLs (no query strings)
-Good dynamic meta tags
-Never have to touch the script again.. It is Y3K compliant, simply re-submit to the engines to update your listings

Install Requirements:

-vBulletin 1.x or 2.x
-about 10 minutes


1) Download the attached Zip.

2) Open class.mysql.php and put your database login info at the top.

3) Create a new directory called archive under your forum, like /forum/archive

4) Open the included .htaccess and change the Error 404 to your new archive path.

5) Open index.php and change the self-explanatory variables at the top of the file.

6) Upload all 3 files to your archive directory.

7) Submit /forum/archive/index.php to search engines and watch em crawl


DISCLAIMER: I don't use 2.x but I checked the schema and this should work fine.

NOTES: This uses ErrorDocument and query string parsing to get the variables needed. I do not have the time or energy to troubleshoot this if it does not work on your server. Sorry!

[etones]

Overgrow ... Ya just a god damm GENIUS!

Your hacks are just toooo good man, keep em up..

and is that you with the afro...? If so.. damm your a kewl succer

[chrispadfield]

just installed in less than 5 minutes, amazing hack thanks so much

[Overgrow]

Welcome guys... I don't sport the fro no mo... (hey man slap mah fro)

....did anyone get their archive in this last Google update? I was too slow for this one, but I have seen the googlebot back a few hundred times since then so I think he's starting to take the bait.

[Overgrow]

OK! If everyone has left their footer intact (you did read the big licensing agreement at the top, right?) --- then we officially have our FIRST VBULLETIN SPIDERED INTO GOOGLE!

Congrats Streicher of Studenten-city.de!

The one guy that had some of the worst trouble installing this piece-of-hack-- he's the guy that manages to get in Google first! Only a few pages so far but now the spider knows where you live

http://www.google.com/search?q=vbspiderfriend

[chrispadfield]

someone's referral stats are going to get pushed up by this in google but you deserve it and that 5 times over.

my footer is of course still there

www.ascifi.com/forums/archive/

[chrispadfield]

<a href="http://www.alltheweb.com/cgi-bin/search?type=all&query=vbspiderfriend" target="_blank">http://www.alltheweb.com/cgi-bin/sea...vbspiderfriend</a>

I can get it to work, but not on a subdomain. Is there away to make it work with subdomains?

sorry, but I do not get it to work. is there a hhtpd.conf setting I am missing?

I have the .htacces-file in place in /archiv, but i still get the 404-message that is defined in the .htaccess in htdoc-root - doesn't the .htaccess in /archive-directory overwrite the root one?

[Overgrow]

jamez: sorry no clue on subdomains, you need more of a linux expert than me.

robert! didn't know you were still having trouble.. I believe the setting you are looking for will be in access.conf (possibly httpd.conf)... it is called "Allow Override" for .htaccess on a directory level. It is fairly well documented inside of the file. You need to Allow Override All or at least the part about redirects.

hope this helps... I'm sure someone with more apache knowledge can offer better advice.

Yeah, I found that on apache.org and in httpd.conf and I enabled it. Now my customized error document defined via a .htaccess file in / works fine, but not in /archiv.

anyone here that can help me?!