Go Back   vb.org Archive > vBulletin 3 Discussion > vB3 General Discussions
  #1  
Old 11-29-2002, 05:24 AM
SkuZZy SkuZZy is offline
 
Join Date: Jul 2002
Posts: 114
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default google spiders 60% of my threads

This hack has been released!

Click here: https://vborg.vbsupport.ru/showthrea...threadid=47087

woohoo

After trying the other two known spider scripts out there (overgrown's hack and fastforward's) and having no luck with them, I decided to try Xenon's. Back in mid-october I added the "beta" archive script (made by xenon, who is awesome) to my forums and just today google finally added many of my threads, about 2000, to their engine! FINALLY!!!

http://www2.google.com/search?hl=en&...ttleforums.com

I might consider releasing the hack (xenon wants me to) if there is enough interest for it... or atleast release it in beta form. However, with the release of vb3.0 so close, i'm not sure it would be worth the effort to release it as a full hack... so maybe just release it as a beta the way it is ( as seen at http://www.battleforums.com/history ) for those who are going to stay with vb2.

Any interest for this to be released? (edit: I've released it, visit https://vborg.vbsupport.ru/showthrea...threadid=47087)
Reply With Quote
  #2  
Old 11-29-2002, 07:00 AM
Smoothie Smoothie is offline
 
Join Date: Oct 2001
Location: New York
Posts: 1,834
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

yep.
Reply With Quote
  #3  
Old 11-29-2002, 07:23 AM
thomas thomas is offline
 
Join Date: Mar 2002
Location: Tokyo, Japan
Posts: 34
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

I'm definitely interested!
Reply With Quote
  #4  
Old 11-29-2002, 10:35 AM
GTGT GTGT is offline
 
Join Date: Jun 2002
Posts: 23
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Hell yes!

Is it the best google hack out there?
Reply With Quote
  #5  
Old 11-29-2002, 10:43 AM
SkuZZy SkuZZy is offline
 
Join Date: Jul 2002
Posts: 114
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally posted by GTGT
Hell yes!

Is it the best google hack out there?
Well, as far as getting threads spidered, yes. It will put all your threads in plain .html and it draws directly from the database, so it's instant. There are some requirements for it though and it is lacking a few features. For instance, it requires mod_rewrite if you want to have the files be .html and there is no feature in it right now to block out private forums selectively. I could probably add those small features to it though, just wondering if it's worth it since 2.2.9 is supposidly the last version of the 2.x.x series... and vb3 will probably be out in a few weeks. Which is why I started this thread, to see how much interest there is for this hack.....
Reply With Quote
  #6  
Old 11-29-2002, 11:19 AM
Xenon's Avatar
Xenon Xenon is offline
 
Join Date: Oct 2001
Location: Bavaria
Posts: 12,878
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

well, there will be much users who won't upgrade fast, so it's worth to release

thanx for the kind words
Reply With Quote
  #7  
Old 11-29-2002, 11:22 AM
Logician's Avatar
Logician Logician is offline
 
Join Date: Nov 2001
Location: inside vb code
Posts: 4,449
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

If Stefan coded it, I'm sure it's great. :classic:

I just wonder the algorithm of it: Does it compile .html pages for everythread seperately and save it in the server or does it create the html page on the fly whenever it's requested (without having its physical existence in the server)?

Whatever way it works, so I believe you or Stefan should release it. It will definetely prove useful for many..
Reply With Quote
  #8  
Old 11-29-2002, 11:44 AM
Xenon's Avatar
Xenon Xenon is offline
 
Join Date: Oct 2001
Location: Bavaria
Posts: 12,878
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

well, the html file save process is skuzzy's work, my script just created &? free urls....
Reply With Quote
  #9  
Old 11-29-2002, 02:39 PM
Velocd's Avatar
Velocd Velocd is offline
 
Join Date: Mar 2002
Location: CA University
Posts: 1,696
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Skuzzy forgot to mention that is he still using some of the code from either overgrown's or fastforward's hack, which is why it's producing the .html extensions, and which is why search engines are picking up on it better. The visual appearance and layout of his Archiv Hack is much different than original, not to mention the original purpose of the first archiv hack wasn't to allow easier spidering for search engines..but reduced file size in database.

Anyway, Skuzzy please if you could share the method for doing this as Logician mentioned. It would be of great help
Reply With Quote
  #10  
Old 11-30-2002, 03:10 PM
SkuZZy SkuZZy is offline
 
Join Date: Jul 2002
Posts: 114
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally posted by Velocd
Skuzzy forgot to mention that is he still using some of the code from either overgrown's or fastforward's hack, which is why it's producing the .html extensions, and which is why search engines are picking up on it better. The visual appearance and layout of his Archiv Hack is much different than original, not to mention the original purpose of the first archiv hack wasn't to allow easier spidering for search engines..but reduced file size in database.

Anyway, Skuzzy please if you could share the method for doing this as Logician mentioned. It would be of great help
I'm not using any code from overgrowns hack. Overgrown's hack never made .html extensions, just directories... but it used 404 errors to do them, which search engines don't like. But with these scripts, I simply used mod_rewrite to do the .html part. It was pretty easy and it's all done server-side, so google can't tell the difference. The .html files don't actually exist though. About fastforward's hack, i'm not using any of his code, but it's the same basic idea. The only difference is, these archive scripts require no hacking of the board, it shouldn't even really be considered a hack, just an "addon". It's as simple as uploading the 3 scripts to a sub-directory and changing a few variables (you need to have mod_rewrite enabled though). With fastforward's hack (not that I have anything against it, it's a good hack) you needed to modify alot of templates and it gets pretty messy. Plus, with vb3 around the corner, it is silly to hack a board up when upgrading will soon be here

But anyways, i've made up my mind... I will be releasing this hack. I'm going to add a few variables to it and clean it up a bit and should release it over the weekend, if I get some time. I want to state once again though, this is xenon's hack and he is the mastermind behind it, i've just spiced it up a bit.

So look forward to seeing this "addon" soon.

Thanks,
SkuZZy
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 09:58 PM.


Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2024, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.04481 seconds
  • Memory Usage 2,257KB
  • Queries Executed 13 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)ad_showthread_beforeqr
  • (1)ad_showthread_firstpost
  • (1)ad_showthread_firstpost_sig
  • (1)ad_showthread_firstpost_start
  • (2)bbcode_quote
  • (1)footer
  • (1)forumjump
  • (1)forumrules
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (1)navbar
  • (3)navbar_link
  • (120)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (2)pagenav_pagelink
  • (10)post_thanks_box
  • (10)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (10)post_thanks_postbit_info
  • (10)postbit
  • (10)postbit_onlinestatus
  • (10)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open
  • (1)tagbit_wrapper 

Phrase Groups Available:
  • global
  • inlinemod
  • postbit
  • posting
  • reputationlevel
  • showthread
Included Files:
  • ./showthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_postinfo_query
  • fetch_postinfo
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showthread_start
  • showthread_getinfo
  • forumjump
  • showthread_post_start
  • showthread_query_postids
  • showthread_query
  • bbcode_fetch_tags
  • bbcode_create
  • showthread_postbit_create
  • postbit_factory
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • fetch_musername
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • pagenav_page
  • pagenav_complete
  • tag_fetchbit_complete
  • forumrules
  • navbits
  • navbits_complete
  • showthread_complete