vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vB3 General Discussions (https://vborg.vbsupport.ru/forumdisplay.php?f=111)
-   -   Big Problems - oh no! (https://vborg.vbsupport.ru/showthread.php?t=117578)

kevinmanphp2 06-03-2006 11:10 PM

Big Problems - oh no!
 
I have very large vB forums and have noticed that all the search engines are indexing many of the same page with various urls, even though I bock all pages except for showthread.php in robots.txt.

For instance... google has indexed the following versions of the same showthread.php thread:

/showthread.php?p=48043&mode=linear
/showthread.php?mode=hybrid&t=2491
/showthread.php?t=2490&goto=nextoldest
/showthread.php?p=48043&page=2&pp=25
/showthread.php?t=2491&page=1&pp=25
/showthread.php?goto=lastpost&t=2491
/showthread.php?p=50108&mode=linear
/showthread.php?p=48043&mode=threaded
/showthread.php?p=50108&mode=threaded


NOTE: All these links point to the EXACT same thread!!!

I have looked around at other vB forums on the net and no one else has this problem. Is there anyway to stop this? Thanks for your help!

Dan 06-03-2006 11:11 PM

What's happening is Google is spidering your site and finding the links to the different versions of the linear or threaded or different types of links, it may be because of your members viewing habits where they link to a thread with different types of links and google catches it and spiders it.

kevinmanphp2 06-03-2006 11:14 PM

Any idea how this can be fixed???... about 100,000+ (I am guessing.. since google will only show me couple thousand approx.) all have been indexed in the various ways listed above... making my forums sit in the "supplemental" index because of duplicate content.

calorie 06-03-2006 11:27 PM

Oldie but maybe goodie: https://vborg.vbsupport.ru/showpost.php?p=609808

peterska2 06-03-2006 11:44 PM

I wouldn't think so Calorie, that's 3.0.x code :(

calorie 06-04-2006 01:12 AM

peterska2, it should still be okay as long as the following isn't a vB page, but this was true then also.
Code:

$zzzz_domain_tld
PS: you could stick the code in a plugin using the init_startup hook.


All times are GMT. The time now is 01:36 PM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.00957 seconds
  • Memory Usage 1,719KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)bbcode_code_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (6)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete