vbSpiderFriend - Search Engine Friendliness

I am tired of my 200,000 posts not being listed in Google. I was inspired by phpbuilder.com this morning and I wrote:

vbSpiderFriend - the search engine indexer for all of your posts

Purpose: Allow search engine spiders to crawl a linked list of all of your posts.

Project Requirements:

-Friendly URLs (no query strings)
-Good dynamic meta tags
-Never have to touch the script again.. It is Y3K compliant, simply re-submit to the engines to update your listings

Install Requirements:

-vBulletin 1.x or 2.x
-about 10 minutes


1) Download the attached Zip.

2) Open class.mysql.php and put your database login info at the top.

3) Create a new directory called archive under your forum, like /forum/archive

4) Open the included .htaccess and change the Error 404 to your new archive path.

5) Open index.php and change the self-explanatory variables at the top of the file.

6) Upload all 3 files to your archive directory.

7) Submit /forum/archive/index.php to search engines and watch em crawl


DISCLAIMER: I don't use 2.x but I checked the schema and this should work fine.

NOTES: This uses ErrorDocument and query string parsing to get the variables needed. I do not have the time or energy to troubleshoot this if it does not work on your server. Sorry!

I have the same problem like Streicher when i click on a forumlink with an ID <10 the page reloads only.
you have an idea why?

cu

soon after I included this hack on my site, google kicked me out completely...
Hope it doesn't have to do anything with this hack...

Hi Overgrow,

These are just some general questions as regard to this hack.

As google and a few others can spider ? and & URLs what other advantages does this hack have other than all the dynamic meta tags?

What I'm getting at is - if I can do all the dynamic meta tags etc straight into my vB then removing them from the equation why would this hack improve the ability for search engines to spider.

As far as I can see the only difference would be the / in the URL's as opposed to ? and &'s. Are there any other advantages? Are they easier to spider because 'less clutter' from CSS, images etc?

Just wondering as I'm not that enlightened on exactly how search engines (specifically google) work, and what are all the benifits of this script over just inserting dynamic meta tags straight into your actual forum pages.

Cheers

[eva2000]

Originally posted by Overgrow
Congrats to Eva of Animeboards who now has his vBulletin spidered by Google! He has a good page rank evidently since Google went very deep on only it's first pass. Animeboards now has 11,700 new pages listed in Google with the spiderFriend!

edit: changed Eva's gender to more correctly reflect the actual person

thanks overgrow, my pagerank boost was from linking to my main site eva2000.com which has a very very high rank

unfortunately your hack doesn't seem to show threads anymore?

any updates?

[eva2000]

never mind i found my problem, each forum upgrade i start with a new database and perserve the previous version database as a copy but forgot to change the config file for your hack to point to the new db

eva2000: did you submit your page to google again, or did google visit you automatically?
If you submitted, did you submit www.yourdomain.com or did you submit www.yourdomain.com/forum/archive/ ?

[eva2000]

Originally posted by robertusss
eva2000: did you submit your page to google again, or did google visit you automatically?
If you submitted, did you submit www.yourdomain.com or did you submit www.yourdomain.com/forum/archive/ ?

i submited my main domain page along with a particular archive thread i really want to see indexed and just wait

[dwh]

Are you sure you folks aren't putting out 404 error pages?

http://www.phpbuilder.net/annotate/m...hp3?id=1000365

Did anyone ever figure out why some people had a problem where any of the links reloads the index.php page?

Here is an example http://www.reefcentral.com/vbulletin/archive/index.php

I'd love to get this hack to work.

What are the major search engines other than Google that this hack would work on?