Go Back   vb.org Archive > vBulletin Modifications > Archive > vB.org Archives > vBulletin 2.x > vBulletin 2.x Full Releases
FAQ Community Calendar Today's Posts Search

Reply
 
Thread Tools
vB Easy Archive FINAL - Search Engine Spiderable Hack! Get your posts listed @ google Details »»
vB Easy Archive FINAL - Search Engine Spiderable Hack! Get your posts listed @ google
Version: 1.00, by SkuZZy SkuZZy is offline
Developer Last Online: Jun 2004 Show Printable Version Email this Page

Version: 2.3.x Rating:
Released: 12-28-2002 Last Update: Never Installs: 206
 
No support by the author.

-- If you've installed this hack, please click here! -- If you want to upgrade to vBulletin 3, look here: https://vborg.vbsupport.ru/showthread.php?t=65703

[high]HOW GOOD DOES THIS HACK WORK??? >>> [/high]Over 29,000 pages spidered since January 1st!!!!!!! Visit http://www3.google.com/search?hl=en&...e+SkuZZy+Xenon to see all the pages this script has helped get spidered into google!

Sub-Forums have been added!

Final Version Released - February 10th

I added sub-forums in this final version, one of the most requested features to be added... but, sad to say... this will be the final version. I never got a chance to add some of the cool features I said, but I feel this archive has served it's purpose and hopefully will continue to do so for all the die hard users who stick with vb 2.2.9. I decided to make this the final version because vb3 is coming out soon and I think this archive is the best archive currently out. Sure, there are more flashy ones, but this one gets the job done and gets results. Hopefully this hack will live on for a while.
Edit by Xenon: Whenever there is a problem, i'll take a look at it, and perhaps add a feature or two

About this hack

This hack will help get all your threads listed in google and other search engines and get your threads easily spidered! It works by creating an archive and turning all your posts into .html format. It doesn't actually create the .html files though, but google thinks they are real! It uses mod_Rewrite. If you don't have mod_Rewrite, you can't use the scripts (sorry).

What does it do?

The purpose of this hack are to get your keywords from your forums listed in google and get people visiting them! Since these are all pure text and don't use tables or excess font tags, they are very friendly on bandwidth! This will display all your files in a nice text format that google will absolutely love! Visit the online demo below to see it in action!

Online Demos

To view a demo of this script, visit some of the "live" demos at the following sites:

http://www.destee.com/forums/archives
http://www.thrillnetwork.com/boards/archive/
http://www.truecountry.com/forums/history/
http://www.strategy-forum.de/easy_archive/index.php
http://www.pimprig.com/forums/archive/
http://www.jokersrewards.com/forum/history/
http://board.midibuddy.net/archive2/
http://x-mencomics.com/xfan/forums/archive/
http://www.macfora.com/forums/archive/
http://www.rcgroups.com/archive/
http://www.codewebs.com/forums/archive/
http://www.lcdmod.com/forums/archive/
http://www.source-forums.org/vB/archive/
http://www.subduck.com/history/
http://www.thesistersthree.com/archive/
http://www.a51forums.com/archive/
http://www.yes-its-free.com/easyarchive/
http://www.wcgateway.com/forums/archive
http://www.toyotaimportsforum.co.uk/forum/archive/
http://www.prisontalk.com/forums/archive/
http://www.gamesites200.com/archive/
http://www.allthingsmoto.com/archive
http://www.2spoemas.com/foros/archive/
http://www.mysticwicks.com/archive/

Requirements

Apache
vBulletin 2.x
mod_mime installed
.htaccess
5 minutes of your time...


Known Problems/Confusion

Mod_mime - You will NEED mod_mime to run these scripts. Mod_mime is a free module which enables a directive called "ForceType". This allows you to use the .htaccess file included to force your files into php mode, which allows simple URL's, without .php in them. If you can see the front page of your archive, but get an error page when you click on any links then this is your problem. To fix it, you will need to install mod_mime, or ask your host to do it. It's a FREE module. For more information, visit http://httpd.apache.org/docs/mod/mod_mime.html

Private forums - Private forums are NOT shown and they will NOT be spidered. Some people say the private forums show up, that is because you are logged in as the admin and the archive uses permissions. So anyone who has permission to view the private forums on your forums, will beable to view them on the archives also. But if you log out of your account OR log into an account that doesn't have access to them, then you won't beable to view them

Credits

Biggest credit goes to Xenon who originally coded the scripts. He is the man! Also thanks to everyone who tested it out for me and kept bugging me about releasing it (when I was too lazy to).

Agreement

By using these scripts & installing them, you agree to leave the small (virtually unnoticable) copyright text and links at the bottom of all pages. You also agree to leave jelsoft's copyright there as well. You can modify the scripts much as you want, but this portion must remain intact (links must stay) and visible. This is all we ask

Download Final

To install, just download the file below and open the "_readme.txt" file. All is explained there. Installation should only take a couple of minutes. If you have problems with this script, post them in this thread and I will try and get around to answering them.

Show Your Support

  • This modification may not be copied, reproduced or published elsewhere without author's permission.

Comments
  #142  
Old 01-08-2003, 12:34 PM
cklaszlo cklaszlo is offline
 
Join Date: Nov 2001
Posts: 83
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally posted by SkuZZy


Nice job! It's good to submit your archive and add a link to it.

Google will add pages at the end of the month. The main spidering happens 5 days after the dance. The dance is when google updates all links and adds newly spidered pages. The dance this month was January 1st. So spidering happens between the 5th and 10th. All the pages spidered between the 5th and 10th will be added on the next dance, which will happen at the end of January or maybe very early febuary. So to answer your question, in about 3 weeks a ++++ load of your pages will be spidered.

On this note, i'd like to add one more thing. Not all your pages will be added to google at once. They only add a certain percentage per month to prevent spamming. I think it's like 2000 pages per month available to be added. (Each thread counts as 1 page). So about 2000 of your threads will get put in google the first month. Be patient though, the next month will get even more added!

SkuZZy
Good to know. Thanks. Now, not that I am complaining but this is now day 5 and crawl.googlebot.com is back at it. For about 4 hours this morning. How many days, on average, will it crawl? And , ad revenue page views!!!

Now if someone would only help me in placing a black border around the archive links. hint hint.

Thanks,

Alex
Reply With Quote
  #143  
Old 01-08-2003, 01:15 PM
hamed's Avatar
hamed hamed is offline
 
Join Date: May 2002
Posts: 25
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally posted by SkuZZy


VB code is activated automatically... and your welcome
Thank you for your reply. But some parts of it are not working. Like IMG tags and links.

Tanx again. This hack is the best vb archive system ever .
Reply With Quote
  #144  
Old 01-08-2003, 01:22 PM
cklaszlo cklaszlo is offline
 
Join Date: Nov 2001
Posts: 83
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally posted by hamed


Thank you for your reply. But some parts of it are not working. Like IMG tags and links.

Tanx again. This hack is the best vb archive system ever .
For us as well. VB code isn't working:

http://www.thrillnetwork.com/boards/...pic/3616.html?

Thanks,

Alex
Reply With Quote
  #145  
Old 01-08-2003, 03:05 PM
NTLDR's Avatar
NTLDR NTLDR is offline
Coder
 
Join Date: Apr 2002
Location: Bristol, UK
Posts: 3,644
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally posted by SkuZZy
If you really need to use a color similiar, then use one that is very light.
Thanks, I've changed it to the same colour as my footer text, while were on this kin d of subject, I modified the archive so that if it dedects MSIE or Mozilla in the User Agent then it redirects to the actual page (eg showthread.php?threadid=X), would you suggest that I remove that code? I'm not sure if google would look down on that too, I'm guessing they would.

Quote:
BTW, I like your avatar. Is that you? Or is it one of the three sisters or whatever.
*lol* Unfortunaly its not me, wrong gender for starters Its Rose McGowan who plays Paige in Charmed.
Reply With Quote
  #146  
Old 01-08-2003, 06:40 PM
Mutt's Avatar
Mutt Mutt is offline
 
Join Date: Nov 2001
Posts: 331
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally posted by Velocd
For those of you having chdir() problems, the only code you should need inside the chdir() is the following:

PHP Code:
chdir("../forums");
require(
"global.php"); 
I was getting the blank page too, but this fixed it. Thanks
Reply With Quote
  #147  
Old 01-08-2003, 07:32 PM
Mutt's Avatar
Mutt Mutt is offline
 
Join Date: Nov 2001
Posts: 331
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally posted by NTLDR
I modified the archive so that if it dedects MSIE or Mozilla in the User Agent then it redirects to the actual page
mind sharing the code changes

I changed a line in topic from this
PHP Code:
echo "<html><body><head><title>[$thread[title]] - $title</title></head><base href=\"$forumurl/\">"
to this
PHP Code:
echo "<html><body><head><title>[$thread[title]] - $title</title>
<script>
var browser_type=navigator.appName
if (browser_type==\"Netscape\"||browser_type==\"Microsoft Internet Explorer\") {
window.location.replace(\"
$forumurl/showthread.php?s=&threadid=$thread[threadid]\")
}
</script>
</head><base href=\"
$forumurl/\">"
It seems to work, but will this screw up the search spidering?
Reply With Quote
  #148  
Old 01-08-2003, 09:22 PM
NTLDR's Avatar
NTLDR NTLDR is offline
Coder
 
Join Date: Apr 2002
Location: Bristol, UK
Posts: 3,644
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Google has been on my site browsing through the archive with no problems, its just the issue of wether or not they allow it. Heres the changes I made:

index.php right after you have required config.php add:

PHP Code:
    // check the browser and redirect if needed
    
if (eregi("MSIE",$HTTP_USER_AGENT)) { // browser is IE
        
header("Location: $forumurl");

    } elseif (
eregi("Mozilla/5.0",$HTTP_USER_AGENT)) { // browser is NS 6
        
header("Location: $forumurl");

    } elseif (
eregi("Mozilla/4.",$HTTP_USER_AGENT)) { // browser is NS4
        
header("Location: $forumurl");
    } 
topic again add after requiring config.php:

PHP Code:
    // check the browser and redirect if needed
    
if (eregi("MSIE",$HTTP_USER_AGENT)) { // browser is IE
        
header("Location: $forumurl/showthread.php?threadid=$threadid");

    } elseif (
eregi("Mozilla/5.0",$HTTP_USER_AGENT)) { // browser is NS 6
        
header("Location: $forumurl/showthread.php?threadid=$threadid");

    } elseif (
eregi("Mozilla/4.",$HTTP_USER_AGENT)) { // browser is NS4
        
header("Location: $forumurl/showthread.php?threadid=$threadid");
    } 
And forum (as above for code placement):

PHP Code:
// check the browser and redirect if needed
    
if (eregi("MSIE",$HTTP_USER_AGENT)) { // browser is IE
        
header("Location: $forumurl/forumdisplay.php?forumid=$forumid");

    } elseif (
eregi("Mozilla/5.0",$HTTP_USER_AGENT)) { // browser is NS 6
        
header("Location: $forumurl/forumdisplay.php?forumid=$forumid");

    } elseif (
eregi("Mozilla/4.",$HTTP_USER_AGENT)) { // browser is NS4
        
header("Location: $forumurl/forumdisplay.php?forumid=$forumid");
    } 
Reply With Quote
  #149  
Old 01-08-2003, 09:29 PM
codewebs codewebs is offline
 
Join Date: Dec 2002
Posts: 71
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

isnt that called like mirroring or masking or something? (google spent 5 hours on my archive yesterday )
Reply With Quote
  #150  
Old 01-08-2003, 09:39 PM
codewebs codewebs is offline
 
Join Date: Dec 2002
Posts: 71
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

heres the answers: (off google.com)

Quality Guidelines - Specific recommendations:

Avoid hidden text or hidden links.
Don't employ cloaking or sneaky redirects.
Don't send automated queries to Google.
Don't load pages with irrelevant words.
Don't create multiple pages, subdomains, or domains with substantially duplicate content.
Avoid "doorway" pages created just for search engines, or other "cookie cutter" approaches such as affiliate programs with little or no original content

EDIT: Im getting spidered again!!! also i added another hack so threads and forums are .html and google is liking it.
Reply With Quote
  #151  
Old 01-08-2003, 09:41 PM
NTLDR's Avatar
NTLDR NTLDR is offline
Coder
 
Join Date: Apr 2002
Location: Bristol, UK
Posts: 3,644
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Thanks codewebs, do you have a link to that page? I looked for guidelines but couldn't find them!

I think I'll remove the redirects based on browsers to be sure
Reply With Quote
Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 11:17 AM.


Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2024, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.09577 seconds
  • Memory Usage 2,354KB
  • Queries Executed 25 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)ad_showthread_beforeqr
  • (6)bbcode_php
  • (7)bbcode_quote
  • (1)footer
  • (1)forumjump
  • (1)forumrules
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (1)modsystem_post
  • (1)navbar
  • (6)navbar_link
  • (120)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (4)pagenav_pagelink
  • (3)pagenav_pagelinkrel
  • (11)post_thanks_box
  • (11)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (11)post_thanks_postbit_info
  • (10)postbit
  • (11)postbit_onlinestatus
  • (11)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open
  • (1)tagbit_wrapper 

Phrase Groups Available:
  • global
  • inlinemod
  • postbit
  • posting
  • reputationlevel
  • showthread
Included Files:
  • ./showthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showthread_start
  • showthread_getinfo
  • forumjump
  • showthread_post_start
  • showthread_query_postids
  • showthread_query
  • bbcode_fetch_tags
  • bbcode_create
  • showthread_postbit_create
  • postbit_factory
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • fetch_musername
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • pagenav_page
  • pagenav_complete
  • tag_fetchbit_complete
  • forumrules
  • navbits
  • navbits_complete
  • showthread_complete