Go Back   vb.org Archive > vBulletin Modifications > Archive > vB.org Archives > vBulletin 2.x > vBulletin 2.x Full Releases

Reply
 
Thread Tools
Details »»

Version: , by fastforward fastforward is offline
Developer Last Online: Nov 2011 Show Printable Version Email this Page

Version: 2.2.x Rating:
Released: 05-24-2001 Last Update: Never Installs: 35
 
No support by the author.

For vB 2.0

This little hackette is a quick fix to allow search engine bots to spider your threads.

Although this will allow the bots to index every thread on your site, it will not make the threads 'search engine optimized'. They will see exactly what you see when you visit your site. It simply removes the CGI bits from the URL's which prevents most search engine bots from spidering more than one level deep.

If you want a hack that allows to fully customize how the thread will look to the search engine bot, you should look at Overgrows more complete hack here.

The advantage of this hack over Overgrows is that it does not require htaccess support which can have performance issues. This could also be seen as a disadvantage though as my hack requires that you have mod_rewrite enabled on your Apache Server, whereas Overgrows method should work with just about any web host out there.

Take yer pick

Show Your Support

  • This modification may not be copied, reproduced or published elsewhere without author's permission.

Comments
  #232  
Old 02-04-2003, 09:21 AM
cyc cyc is offline
 
Join Date: Nov 2002
Posts: 48
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally posted by lierduh
The original hack does not change the forums/threads' navigation links. ie.

Pages (5): ? First ... ? 3 4 [5]
Pages (26): ? First ... ? 23 24 [25] 26 ?

So basically the bots can only craw the first page of a single forum. With my addtional hack, the bots will be able to crawl all the threads specified by "Last 30 days" or whatever the default setting is.

This also allows every thread to be crawled even if they are spreaded through more than 4 (or 9) pages.

I have edited my original post to include this hack.
Great job with adding to this awesome hack :banana:

I'm have an issue with the navigation for the thread lists..... http://www.cyclingforums.com/f47 (the links/numbers) would I be right in thinking its a prob with my rewrite rules?

#### edit ####

I've uninstalled the changes that relate to this post, people started complaining about dead links


thanks
Reply With Quote
  #233  
Old 02-04-2003, 07:30 PM
lierduh lierduh is offline
 
Join Date: Jan 2003
Location: Sydney, Australia
Posts: 459
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Edit: Also added RewriteCond for search.php to make sure multi-page search result work properly.

Quote:
Originally posted by Haakon

However, there is a little problem with the last hack (I think it`s the last one). If you look in member list, the page button is now disabled. Someone spotted it in my forum, and I see you`ve also got the problem. Can you fix it

I`ve also got a problem now with some of the thread`s last page will be blank. Not sure if this is because of your hack, but maybe you know something about it?

Thanks,
Haakon
Please add the following to your existing rewriterules, it should fix the memberlist navigation problem:

RewriteCond %{QUERY_STRING} ^(.*)-([0-9]+)\.html$
RewriteRule ^memberlist.php$ memberlist.php?%1&pagenumber=%2? [L]

RewriteCond %{QUERY_STRING} ^(.*)-([0-9]+)\.html$
RewriteRule ^search.php$ search.php?%1&pagenumber=%2? [L]


Edited my original post to reflect this.

Please note, I have changed the positions for the 'perpage' and the 'pagenumber' from my initial post. ie.

It used to be "f123-2-15.html" it is now: "f123-15-2.html"

where 2 is the page number, 15 is 'how many' per page. I changed both the rewriterules as well as the templates to allow me adding the navigation link hack. Please refer to my original post.
Reply With Quote
  #234  
Old 02-04-2003, 07:38 PM
lierduh lierduh is offline
 
Join Date: Jan 2003
Location: Sydney, Australia
Posts: 459
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally posted by cyc


I've uninstalled the changes that relate to this post, people started complaining about dead links


thanks
Please see my recent post regarding 'perpage' and 'pagenumber'.

For all this trouble, Google rewards by sending a bunch of bots everyday hammering the site.

BTW, I selected this hack instead of the archive hack because when visitors click on the Google results, they are taken straight to the forums instead of the archive pages.
Reply With Quote
  #235  
Old 02-04-2003, 11:18 PM
Erwin's Avatar
Erwin Erwin is offline
 
Join Date: Jan 2002
Posts: 7,604
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

lierduh, I've had your system running on my site for the past few months now... works great - Google has added thousands of my pages into its archive.
Reply With Quote
  #236  
Old 02-05-2003, 01:39 AM
cyc cyc is offline
 
Join Date: Nov 2002
Posts: 48
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally posted by lierduh


Please see my recent post regarding 'perpage' and 'pagenumber'.

For all this trouble, Google rewards by sending a bunch of bots everyday hammering the site.

BTW, I selected this hack instead of the archive hack because when visitors click on the Google results, they are taken straight to the forums instead of the archive pages.
I've tried making your suggested changes 3 or 4 times this morning, it works nice except the page links on a thread that spans more than one page.

The same page nav works fine when on the page with the thread headings, just not the threads themselves. BTW i've uninstalled it again cause me users hate dead links :laugh: I'm not using .htaccess because i run the server its on and therefore can edit the conf file.

cheers!
Reply With Quote
  #237  
Old 02-05-2003, 04:14 AM
lierduh lierduh is offline
 
Join Date: Jan 2003
Location: Sydney, Australia
Posts: 459
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally posted by cyc


I've tried making your suggested changes 3 or 4 times this morning, it works nice except the page links on a thread that spans more than one page.

The same page nav works fine when on the page with the thread headings, just not the threads themselves. BTW i've uninstalled it again cause me users hate dead links :laugh: I'm not using .htaccess because i run the server its on and therefore can edit the conf file.

cheers!
You were close.

There is no difference for the Rewriterules between httpd.conf and .htaccess

There are only two areas that could go wrong, that is the templates which generate the URL and the Rewriterule that catches/matches your URL. Again, if you could post the Dead URL and your rewriterules, I might be able to pin point what you did wrong.
Reply With Quote
  #238  
Old 02-05-2003, 04:23 AM
cyc cyc is offline
 
Join Date: Nov 2002
Posts: 48
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally posted by lierduh


You were close.

There is no difference for the Rewriterules between httpd.conf and .htaccess

There are only two areas that could go wrong, that is the templates which generate the URL and the Rewriterules that catches/matches your URL. Again, if you could post the Dead URL and your rewriterules, I might be able to pin point what you did wrong.
I'll reapply the hack now

##### edit ######

I've got it working, my rewrite rules were alittle messed up.

Thanks for your help, I really appreciate it mate!

*waits for google*

cheers!
Reply With Quote
  #239  
Old 02-05-2003, 04:30 AM
lierduh lierduh is offline
 
Join Date: Jan 2003
Location: Sydney, Australia
Posts: 459
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally posted by Erwin
lierduh, I've had your system running on my site for the past few months now... works great - Google has added thousands of my pages into its archive.
Erwin, the original hack is created by fastforward, not by me. I merely posted my own experience (see last page) and I believe I might have made some improvement over the origian hack.
Reply With Quote
  #240  
Old 02-05-2003, 04:52 AM
lierduh lierduh is offline
 
Join Date: Jan 2003
Location: Sydney, Australia
Posts: 459
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally posted by cyc


I've got it working, my rewrite rules were alittle messed up.

Thanks for your help, I really appreciate it mate!

*waits for google*

cheers!
No worries, mate. (some downunder talking there)
Glad it is working for you.

Don't forget the last hack (RewriteCond) regarding the memberlist. Otherwise your member list navigation will not work. Fortunately this is a simple one, only need to add two lines to your rewriterules.

Waiting for more things to break, I am sure there is. eg. Merge Thread does not work anymore due to the new URL. Do I care to fix this is another question.
Reply With Quote
  #241  
Old 02-05-2003, 07:31 AM
Erwin's Avatar
Erwin Erwin is offline
 
Join Date: Jan 2002
Posts: 7,604
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

When I say "your" system, lierduh, I mean the multiple page version of this hack. I don't use the same hack as you, I've customised my own version.
Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 01:17 PM.


Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2024, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.09979 seconds
  • Memory Usage 2,312KB
  • Queries Executed 25 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)ad_showthread_beforeqr
  • (8)bbcode_quote
  • (1)footer
  • (1)forumjump
  • (1)forumrules
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (1)modsystem_post
  • (1)navbar
  • (6)navbar_link
  • (120)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (4)pagenav_pagelink
  • (1)pagenav_pagelinkrel
  • (11)post_thanks_box
  • (11)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (11)post_thanks_postbit_info
  • (10)postbit
  • (11)postbit_onlinestatus
  • (11)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open
  • (1)tagbit_wrapper 

Phrase Groups Available:
  • global
  • inlinemod
  • postbit
  • posting
  • reputationlevel
  • showthread
Included Files:
  • ./showthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showthread_start
  • showthread_getinfo
  • forumjump
  • showthread_post_start
  • showthread_query_postids
  • showthread_query
  • bbcode_fetch_tags
  • bbcode_create
  • showthread_postbit_create
  • postbit_factory
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • fetch_musername
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • pagenav_page
  • pagenav_complete
  • tag_fetchbit_complete
  • forumrules
  • navbits
  • navbits_complete
  • showthread_complete