The Arcive of Official vBulletin Modifications Site.

Have Googlebot Crawl EVERYTHING (theoretically) · **Released**: 03-24-2003

Googlebot supposedly won't crawl links that have sessionhashes (32 character hex strings) in the URLs. So this hack detects when Googlebot is browsing your forum, and if it is, deletes the sessionhash. So, theoretically, Googlebot will be able to crawl every single guest-accessible link on your board. All of them. This means every thread, every forum, every post, even useless stuff like the memberlist and the FAQ.

Simple to install (1 step). This won't get instant gratification because Googlebot will only reindex your site on its next crawl.

Intex · #2 03-25-2003, 05:00 PM

Another great hack filburt1. Not sure I need it crawling my internal site, but nevertheless very cool.

colicab-d · #3 03-25-2003, 05:22 PM

lol so thats why u wanted the sessions code

filburt1 · #4 03-25-2003, 05:38 PM

No it's not...

VampireMan · #5 03-25-2003, 05:54 PM

simple but very effective hack , thanks :-)

Xanthine · #6 03-25-2003, 06:02 PM

Sounds good thanks Filburt

Overgrow · #7 03-25-2003, 06:35 PM

Excellent

One note: This may not allow Google to see all of your posts (theoretically). If you have old ones that would not naturally show up on forumdisplay, Google will not use the select box to see all of the old posts.

Elegantly simple though and makes perfect sense.

[high]* Overgrow clicks install[/high]

Davey · #8 03-25-2003, 06:42 PM

Filburt how did you find that special part of code through all that 'mess'?

.
Thanks.
*Installs*.

Dave.

Webdork · #9 03-25-2003, 08:31 PM

On my site I require registration for users to view threads. Is there a way to allow Google to become a "registered" user so it can crawl all threads still?

filburt1 · #10 03-25-2003, 08:32 PM

Yes but smart users can get around it...

edit: actually I thought of a way to fix that, too. Expect that hack eventually.
note to self: check first few IP bits and HTTP_USER_AGENT, update $bbuserinfo.

corsacrazy · #11 03-25-2003, 08:35 PM

installed

nice one

off topic

how r u lot doing those funky sigs ? i beleive u started the trend filb !

Webdork · #12 03-25-2003, 08:37 PM

I dont really mind if a smart user can get in without registering - my forums arent private I just like to know who is using them. But the true value is of course in having as many threads as possible in Google to attract new users.

Velocd · #13 03-26-2003, 12:21 AM

Nice hack, and I'll be awaiting that suggestion by Webdork in post #9 as well

[high]* Velocd clicks install[/high]

filburt1 · #14 03-26-2003, 01:42 AM

Forgot it, I can't stand looking at sessions.php after trying for an hour.

Slynderdale · #15 03-26-2003, 05:31 PM

Hmm, theres a similar hack for this in Tech's vB Archive hack that also includes several searchbots, not just google.

X vBulletin 3.8.12 by vBS Debug Information
Page Generation 0.09171 seconds Memory Usage 2,323KB Queries Executed 28 (?)
More Information
Template Usage: (1)SHOWTHREAD (1)ad_footer_end (1)ad_footer_start (1)ad_header_end (1)ad_header_logo (1)ad_navbar_below (1)ad_showthread_beforeqr (1)footer (1)forumjump (1)forumrules (1)gobutton (1)header (1)headinclude (1)modsystem_post (1)navbar (6)navbar_link (120)option (1)pagenav (1)pagenav_curpage (2)pagenav_pagelink (15)post_thanks_box (15)post_thanks_button (1)post_thanks_javascript (1)post_thanks_navbar_search (15)post_thanks_postbit_info (14)postbit (15)postbit_onlinestatus (15)postbit_wrapper (1)spacer_close (1)spacer_open (1)tagbit_wrapper Phrase Groups Available: global inlinemod postbit posting reputationlevel showthread	Included Files: ./showthread.php ./global.php ./includes/init.php ./includes/class_core.php ./includes/config.php ./includes/functions.php ./includes/class_hook.php ./includes/modsystem_functions.php ./includes/functions_bigthree.php ./includes/class_postbit.php ./includes/class_bbcode.php ./includes/functions_reputation.php ./includes/functions_post_thanks.php Hooks Called: init_startup init_startup_session_setup_start init_startup_session_setup_complete cache_permissions fetch_threadinfo_query fetch_threadinfo fetch_foruminfo style_fetch cache_templates global_start parse_templates global_setup_complete showthread_start showthread_getinfo forumjump showthread_post_start showthread_query_postids showthread_query bbcode_fetch_tags bbcode_create showthread_postbit_create postbit_factory postbit_display_start post_thanks_function_post_thanks_off_start post_thanks_function_post_thanks_off_end post_thanks_function_fetch_thanks_start post_thanks_function_fetch_thanks_end post_thanks_function_thanked_already_start post_thanks_function_thanked_already_end fetch_musername postbit_imicons bbcode_parse_start bbcode_parse_complete_precache bbcode_parse_complete postbit_display_complete post_thanks_function_can_thank_this_post_start pagenav_page pagenav_complete tag_fetchbit_complete forumrules navbits navbits_complete showthread_complete
Messages:

The Arcive of Official vBulletin Modifications Site.

It is not a VB3 engine, just a parsed copy!