Go Back   vb.org Archive > vBulletin Modifications > Archive > vB.org Archives > General > Big Board Discussions
FAQ Community Calendar Today's Posts Search

Reply
 
Thread Tools
Does Google hate big boards? Details »»
Does Google hate big boards?
Version: , by Ati2 Ati2 is offline
Developer Last Online: Feb 2013 Show Printable Version Email this Page

Version: Unknown Rating:
Released: 06-29-2007 Last Update: Never Installs: 0
 
No support by the author.

Hi, I was wondering what makes some big boards be excluded from Google. Does Google penalize these boards for some reason?

Gaia Online, 1,074,929,715 posts:
Google: about 132,000 from gaiaonline.com

FaceTheJury, 135,719,579 posts:
Google: about 33,100 from forums.facethejury.com

Offtopic.com, 79,896,449 posts:
Google: about 141 from forums.offtopic.com
(!!!)

Show Your Support

  • This modification may not be copied, reproduced or published elsewhere without author's permission.

Comments
  #2  
Old 06-29-2007, 12:33 PM
Yellow Slider Yellow Slider is offline
 
Join Date: Aug 2006
Posts: 249
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

nope,
www.atraf-f.net - 1,200,000~ posts
Results 1 - 10 of about 172,000 from www.atraf-f.net. (0.19 seconds)

in google israel we have 233,000 results
Reply With Quote
  #3  
Old 06-29-2007, 12:50 PM
Ati2 Ati2 is offline
 
Join Date: Jan 2006
Location: Budapest, Hungary
Posts: 32
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

That's the thing. Smaller forums seem to have more indexed pages that bigger ones.

The forum you mentioned has just over 1 million posts, and still has more indexed pages that the forum with 1 BILLION posts.

And that's not the only example. I've heard Google banning some sites with inappropriate content, but all big forums can't fall into this category... And still... Big postcount, small number of indexed pages.

???
Reply With Quote
  #4  
Old 06-29-2007, 01:04 PM
Lpspider Lpspider is offline
 
Join Date: Oct 2005
Posts: 164
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

I think some big boards ask google to exclude them from their index - because they don't WANT to get bigger.
Reply With Quote
  #5  
Old 06-29-2007, 01:15 PM
Ati2 Ati2 is offline
 
Join Date: Jan 2006
Location: Budapest, Hungary
Posts: 32
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by Lpspider View Post
I think some big boards ask google to exclude them from their index - because they don't WANT to get bigger.
Hmm, I never thought of that... This sounds resonable...
Reply With Quote
  #6  
Old 06-29-2007, 02:42 PM
nexialys
Guest
 
Posts: n/a
Default

some sites exclude web crawlers in general not only because of the advertisement, but also because it is resource expensive...

when a web crawler visit your site, it hits hundreds of pages in a minute, compared to a member who can hit 3 or 4 pages per minute...

i have on my site yahoo that crawl my site once per day, 58 to 100 hits per minute... and go after 10 minutes... i have 0 members... just infos... imagine a site with 1 million posts... yahoo would crawl the site like 1000 times the count i have... webhosts hates that...
Reply With Quote
  #7  
Old 06-29-2007, 03:47 PM
SCRIPT3R SCRIPT3R is offline
 
Join Date: Jan 2005
Posts: 1,303
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

not at all.
Reply With Quote
  #8  
Old 07-01-2007, 04:19 AM
ssslippy ssslippy is offline
 
Join Date: Jan 2006
Posts: 877
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

I know yahoo has this horrible habbit of sending 50-100 bots at a time, had 50 the other day on my page.
Reply With Quote
  #9  
Old 07-01-2007, 05:56 AM
Brandon Sheley's Avatar
Brandon Sheley Brandon Sheley is offline
 
Join Date: Mar 2005
Location: Google Kansas
Posts: 4,678
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Maybe bad SEO
Reply With Quote
  #10  
Old 07-10-2007, 04:56 PM
Get Shorty's Avatar
Get Shorty Get Shorty is offline
 
Join Date: Jun 2006
Location: Baton Rouge, LA
Posts: 65
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Most of Offtopic.com's forum are not visible to guests, so it makes sense that they don't have many indexed pages. I don't know about the rest of them though.
Reply With Quote
Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 09:06 PM.


Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.04375 seconds
  • Memory Usage 2,280KB
  • Queries Executed 23 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)ad_showthread_beforeqr
  • (1)bbcode_quote
  • (1)footer
  • (1)forumjump
  • (1)forumrules
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (1)modsystem_post
  • (1)navbar
  • (6)navbar_link
  • (120)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (1)pagenav_pagelink
  • (10)post_thanks_box
  • (10)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (10)post_thanks_postbit_info
  • (9)postbit
  • (9)postbit_onlinestatus
  • (10)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open
  • (1)tagbit_wrapper 

Phrase Groups Available:
  • global
  • inlinemod
  • postbit
  • posting
  • reputationlevel
  • showthread
Included Files:
  • ./showthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showthread_start
  • showthread_getinfo
  • forumjump
  • showthread_post_start
  • showthread_query_postids
  • showthread_query
  • bbcode_fetch_tags
  • bbcode_create
  • showthread_postbit_create
  • postbit_factory
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • fetch_musername
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • pagenav_page
  • pagenav_complete
  • tag_fetchbit_complete
  • forumrules
  • navbits
  • navbits_complete
  • showthread_complete