vB Easy Archive FINAL - Search Engine Spiderable Hack! Get your posts listed @ google

-- If you've installed this hack, please click here! -- If you want to upgrade to vBulletin 3, look here: https://vborg.vbsupport.ru/showthread.php?t=65703

[high]HOW GOOD DOES THIS HACK WORK??? >>> [/high]Over 29,000 pages spidered since January 1st!!!!!!! Visit http://www3.google.com/search?hl=en&...e+SkuZZy+Xenon to see all the pages this script has helped get spidered into google!

Sub-Forums have been added!

Final Version Released - February 10th

I added sub-forums in this final version, one of the most requested features to be added... but, sad to say... this will be the final version. I never got a chance to add some of the cool features I said, but I feel this archive has served it's purpose and hopefully will continue to do so for all the die hard users who stick with vb 2.2.9. I decided to make this the final version because vb3 is coming out soon and I think this archive is the best archive currently out. Sure, there are more flashy ones, but this one gets the job done and gets results. Hopefully this hack will live on for a while.
Edit by Xenon: Whenever there is a problem, i'll take a look at it, and perhaps add a feature or two

About this hack

This hack will help get all your threads listed in google and other search engines and get your threads easily spidered! It works by creating an archive and turning all your posts into .html format. It doesn't actually create the .html files though, but google thinks they are real! It uses mod_Rewrite. If you don't have mod_Rewrite, you can't use the scripts (sorry).

What does it do?

The purpose of this hack are to get your keywords from your forums listed in google and get people visiting them! Since these are all pure text and don't use tables or excess font tags, they are very friendly on bandwidth! This will display all your files in a nice text format that google will absolutely love! Visit the online demo below to see it in action!

Online Demos

To view a demo of this script, visit some of the "live" demos at the following sites:

http://www.destee.com/forums/archives
http://www.thrillnetwork.com/boards/archive/
http://www.truecountry.com/forums/history/
http://www.strategy-forum.de/easy_archive/index.php
http://www.pimprig.com/forums/archive/
http://www.jokersrewards.com/forum/history/
http://board.midibuddy.net/archive2/
http://x-mencomics.com/xfan/forums/archive/
http://www.macfora.com/forums/archive/
http://www.rcgroups.com/archive/
http://www.codewebs.com/forums/archive/
http://www.lcdmod.com/forums/archive/
http://www.source-forums.org/vB/archive/
http://www.subduck.com/history/
http://www.thesistersthree.com/archive/
http://www.a51forums.com/archive/
http://www.yes-its-free.com/easyarchive/
http://www.wcgateway.com/forums/archive
http://www.toyotaimportsforum.co.uk/forum/archive/
http://www.prisontalk.com/forums/archive/
http://www.gamesites200.com/archive/
http://www.allthingsmoto.com/archive
http://www.2spoemas.com/foros/archive/
http://www.mysticwicks.com/archive/

Requirements

Apache
vBulletin 2.x
mod_mime installed
.htaccess
5 minutes of your time...


Known Problems/Confusion

Mod_mime - You will NEED mod_mime to run these scripts. Mod_mime is a free module which enables a directive called "ForceType". This allows you to use the .htaccess file included to force your files into php mode, which allows simple URL's, without .php in them. If you can see the front page of your archive, but get an error page when you click on any links then this is your problem. To fix it, you will need to install mod_mime, or ask your host to do it. It's a FREE module. For more information, visit http://httpd.apache.org/docs/mod/mod_mime.html

Private forums - Private forums are NOT shown and they will NOT be spidered. Some people say the private forums show up, that is because you are logged in as the admin and the archive uses permissions. So anyone who has permission to view the private forums on your forums, will beable to view them on the archives also. But if you log out of your account OR log into an account that doesn't have access to them, then you won't beable to view them

Credits

Biggest credit goes to Xenon who originally coded the scripts. He is the man! Also thanks to everyone who tested it out for me and kept bugging me about releasing it (when I was too lazy to).

Agreement

By using these scripts & installing them, you agree to leave the small (virtually unnoticable) copyright text and links at the bottom of all pages. You also agree to leave jelsoft's copyright there as well. You can modify the scripts much as you want, but this portion must remain intact (links must stay) and visible. This is all we ask

Download Final

To install, just download the file below and open the "_readme.txt" file. All is explained there. Installation should only take a couple of minutes. If you have problems with this script, post them in this thread and I will try and get around to answering them.

[cklaszlo]

Originally posted by SkuZZy


Nice job! It's good to submit your archive and add a link to it.

Google will add pages at the end of the month. The main spidering happens 5 days after the dance. The dance is when google updates all links and adds newly spidered pages. The dance this month was January 1st. So spidering happens between the 5th and 10th. All the pages spidered between the 5th and 10th will be added on the next dance, which will happen at the end of January or maybe very early febuary. So to answer your question, in about 3 weeks a ++++ load of your pages will be spidered.

On this note, i'd like to add one more thing. Not all your pages will be added to google at once. They only add a certain percentage per month to prevent spamming. I think it's like 2000 pages per month available to be added. (Each thread counts as 1 page). So about 2000 of your threads will get put in google the first month. Be patient though, the next month will get even more added!

SkuZZy

Good to know. Thanks. Now, not that I am complaining but this is now day 5 and crawl.googlebot.com is back at it. For about 4 hours this morning. How many days, on average, will it crawl? And , ad revenue page views!!!

Now if someone would only help me in placing a black border around the archive links. hint hint.

Thanks,

Alex

[hamed]

Originally posted by SkuZZy


VB code is activated automatically... and your welcome

Thank you for your reply. But some parts of it are not working. Like IMG tags and links.

Tanx again. This hack is the best vb archive system ever .

[cklaszlo]

Originally posted by hamed


Thank you for your reply. But some parts of it are not working. Like IMG tags and links.

Tanx again. This hack is the best vb archive system ever .

For us as well. VB code isn't working:

http://www.thrillnetwork.com/boards/...pic/3616.html?

Thanks,

Alex

[NTLDR]

Originally posted by SkuZZy
If you really need to use a color similiar, then use one that is very light.

Thanks, I've changed it to the same colour as my footer text, while were on this kin d of subject, I modified the archive so that if it dedects MSIE or Mozilla in the User Agent then it redirects to the actual page (eg showthread.php?threadid=X), would you suggest that I remove that code? I'm not sure if google would look down on that too, I'm guessing they would.

BTW, I like your avatar. Is that you? Or is it one of the three sisters or whatever.

*lol* Unfortunaly its not me, wrong gender for starters Its Rose McGowan who plays Paige in Charmed.

[Mutt]

Originally posted by Velocd
For those of you having chdir() problems, the only code you should need inside the chdir() is the following:

PHP Code:

chdir("../forums");
require("global.php"); 


I was getting the blank page too, but this fixed it. Thanks

[Mutt]

Originally posted by NTLDR
I modified the archive so that if it dedects MSIE or Mozilla in the User Agent then it redirects to the actual page

mind sharing the code changes

I changed a line in topic from this

PHP Code:

echo "<html><body><head><title>[$thread[title]] - $title</title></head><base href=\"$forumurl/\">"; 


to this

PHP Code:

echo "<html><body><head><title>[$thread[title]] - $title</title>
<script>
var browser_type=navigator.appName
if (browser_type==\"Netscape\"||browser_type==\"Microsoft Internet Explorer\") {
window.location.replace(\"$forumurl/showthread.php?s=&threadid=$thread[threadid]\")
}
</script>
</head><base href=\"$forumurl/\">"; 


It seems to work, but will this screw up the search spidering?

[NTLDR]

Google has been on my site browsing through the archive with no problems, its just the issue of wether or not they allow it. Heres the changes I made:

index.php right after you have required config.php add:

PHP Code:

    // check the browser and redirect if needed
    if (eregi("MSIE",$HTTP_USER_AGENT)) { // browser is IE
        header("Location: $forumurl");

    } elseif (eregi("Mozilla/5.0",$HTTP_USER_AGENT)) { // browser is NS 6
        header("Location: $forumurl");

    } elseif (eregi("Mozilla/4.",$HTTP_USER_AGENT)) { // browser is NS4
        header("Location: $forumurl");
    } 


topic again add after requiring config.php:

PHP Code:

    // check the browser and redirect if needed
    if (eregi("MSIE",$HTTP_USER_AGENT)) { // browser is IE
        header("Location: $forumurl/showthread.php?threadid=$threadid");

    } elseif (eregi("Mozilla/5.0",$HTTP_USER_AGENT)) { // browser is NS 6
        header("Location: $forumurl/showthread.php?threadid=$threadid");

    } elseif (eregi("Mozilla/4.",$HTTP_USER_AGENT)) { // browser is NS4
        header("Location: $forumurl/showthread.php?threadid=$threadid");
    } 


And forum (as above for code placement):

PHP Code:

// check the browser and redirect if needed
    if (eregi("MSIE",$HTTP_USER_AGENT)) { // browser is IE
        header("Location: $forumurl/forumdisplay.php?forumid=$forumid");

    } elseif (eregi("Mozilla/5.0",$HTTP_USER_AGENT)) { // browser is NS 6
        header("Location: $forumurl/forumdisplay.php?forumid=$forumid");

    } elseif (eregi("Mozilla/4.",$HTTP_USER_AGENT)) { // browser is NS4
        header("Location: $forumurl/forumdisplay.php?forumid=$forumid");
    } 


[codewebs]

isnt that called like mirroring or masking or something? (google spent 5 hours on my archive yesterday )

[codewebs]

heres the answers: (off google.com)

Quality Guidelines - Specific recommendations:

Avoid hidden text or hidden links.
Don't employ cloaking or sneaky redirects.
Don't send automated queries to Google.
Don't load pages with irrelevant words.
Don't create multiple pages, subdomains, or domains with substantially duplicate content.
Avoid "doorway" pages created just for search engines, or other "cookie cutter" approaches such as affiliate programs with little or no original content

EDIT: Im getting spidered again!!! also i added another hack so threads and forums are .html and google is liking it.

[NTLDR]

Thanks codewebs, do you have a link to that page? I looked for guidelines but couldn't find them!

I think I'll remove the redirects based on browsers to be sure