Go Back   vb.org Archive > vBulletin 4 Discussion > vB4 General Discussions
FAQ Community Calendar Today's Posts Search

Reply
 
Thread Tools Display Modes
  #1  
Old 12-24-2014, 06:47 AM
edw1313 edw1313 is offline
 
Join Date: Dec 2014
Posts: 7
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default Ways to index more pages on Google

The forum has more than 300,000 pages loaded to sitemaps (generated by DragonByte) but Google indexed about 200,000 of pages.

O have noticed that some topic treads (categories) are indexed and some (mostly located deeper) are not. for example:

http://avforum.no/forum/forum135/index52.html INDEXED
http://avforum.no/forum/forum135/index92.html NOT INDEXED

I have a feeling that Google can't reach these links on site and ignores sitemaps. Any idea how to make ALL pages of all treads indexed?
I have increased "Number of Pages Visible in Page Navigator" - it shows more pages at once now

what else can be done to improve indexing of forum's pages?
Reply With Quote
  #2  
Old 12-24-2014, 09:44 AM
Seven Skins's Avatar
Seven Skins Seven Skins is offline
 
Join Date: Sep 2008
Location: London, UK
Posts: 1,481
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Google may not index all the pages:

Quote for google:
Quote:
Although we index billions of webpages and are constantly working to increase the number of pages we include, we don't guarantee that we'll crawl all of the pages of a particular site. Google doesn't crawl all the pages on the web, and we don't index all the pages we crawl. It's perfectly normal for not all the pages on a site to be indexed.
Reply With Quote
2 благодарности(ей) от:
ozzy47, RichieBoy67
  #3  
Old 12-24-2014, 11:23 AM
RichieBoy67's Avatar
RichieBoy67 RichieBoy67 is offline
 
Join Date: Apr 2004
Location: CT - Down in a hole..
Posts: 3,057
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by edw1313 View Post
The forum has more than 300,000 pages loaded to sitemaps (generated by DragonByte) but Google indexed about 200,000 of pages.

O have noticed that some topic treads (categories) are indexed and some (mostly located deeper) are not. for example:

http://avforum.no/forum/forum135/index52.html INDEXED
http://avforum.no/forum/forum135/index92.html NOT INDEXED

I have a feeling that Google can't reach these links on site and ignores sitemaps. Any idea how to make ALL pages of all treads indexed?
I have increased "Number of Pages Visible in Page Navigator" - it shows more pages at once now

what else can be done to improve indexing of forum's pages?
Many of those threads are most likely already indexed. Google tends to ignore most duplicate content and you do not really need those index pages indexed if the content with in is already there.

To improve your content pages indexing add more content to those existing threads and do some internal linking as well. For example: If you have a good thread about mustangs that also talks about Corvettes, put a link with good anchor text inside that post to the vette page.

It is also a good idea to go into Google and see which pages are your popular ones and do some internal linking on those pages. This not only helps with bounce rates but also helps ensure that Google will crawl those pages.

Also, go through your oldest threads and update the content a bit. Naturally add some keywords, internal linking, etc. This can help give some of those older threads more life in Google.
Reply With Quote
2 благодарности(ей) от:
Brandon Sheley, ozzy47
  #4  
Old 12-27-2014, 01:15 PM
edw1313 edw1313 is offline
 
Join Date: Dec 2014
Posts: 7
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by RichieBoy67 View Post
Also, go through your oldest threads and update the content a bit. Naturally add some keywords, internal linking, etc. This can help give some of those older threads more life in Google.

Thank you for your suggestion. I wonder how it can be done automatically not manually - I mean placing links to 100,000 pages manually is probably not a good idea.

Google may ignore some pages because of the nature of the forum - because the older content is going down, and new content is always up, there may be duplicate content under different URLs - when old content moved to the 2nd page and one page was already indexed and the other is not...
Reply With Quote
  #5  
Old 12-27-2014, 01:26 PM
RichieBoy67's Avatar
RichieBoy67 RichieBoy67 is offline
 
Join Date: Apr 2004
Location: CT - Down in a hole..
Posts: 3,057
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

There is no way to do it automatically in a natural way. You do not need to go through all of your pages. use Google Analytic and other tools, screaming frog, etc to see which pages you could improve and focus on a few.

A good place to start is your best landing pages that are getting the best traffic. Add some internal links and use the weight of those pages to help other related pages.

Oh yeah, and you do not want to place links on all the pages. Just a few here and there naturally.
Reply With Quote
Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 01:44 AM.


Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.04210 seconds
  • Memory Usage 2,210KB
  • Queries Executed 11 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)ad_showthread_beforeqr
  • (1)ad_showthread_firstpost
  • (1)ad_showthread_firstpost_sig
  • (1)ad_showthread_firstpost_start
  • (3)bbcode_quote
  • (1)footer
  • (1)forumjump
  • (1)forumrules
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (1)navbar
  • (3)navbar_link
  • (120)option
  • (5)post_thanks_box
  • (4)post_thanks_box_bit
  • (5)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (2)post_thanks_postbit
  • (5)post_thanks_postbit_info
  • (5)postbit
  • (5)postbit_onlinestatus
  • (5)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open
  • (1)tagbit_wrapper 

Phrase Groups Available:
  • global
  • inlinemod
  • postbit
  • posting
  • reputationlevel
  • showthread
Included Files:
  • ./showthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showthread_start
  • showthread_getinfo
  • forumjump
  • showthread_post_start
  • showthread_query_postids
  • showthread_query
  • bbcode_fetch_tags
  • bbcode_create
  • showthread_postbit_create
  • postbit_factory
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • fetch_musername
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • post_thanks_function_fetch_thanks_bit_start
  • post_thanks_function_show_thanks_date_start
  • post_thanks_function_show_thanks_date_end
  • post_thanks_function_fetch_thanks_bit_end
  • post_thanks_function_fetch_post_thanks_template_start
  • post_thanks_function_fetch_post_thanks_template_end
  • tag_fetchbit_complete
  • forumrules
  • navbits
  • navbits_complete
  • showthread_complete