Go Back   vb.org Archive > vBulletin 3 Discussion > vB3 General Discussions
FAQ Community Calendar Today's Posts Search

Reply
 
Thread Tools Display Modes
  #1  
Old 06-20-2005, 08:49 PM
maxpot maxpot is offline
 
Join Date: Jun 2005
Posts: 4
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default Google not spidering...

Hi all, first post.

My forums page is at www.parttimepoker.com/parttimeboard. I recently [on the 16th or so] switched from the phpBB to a vbulletin board.

Google had spidered the old board pretty completely, and the index page for the forums has a PR 3. My main site is spidered thoroughly, and most of the core section pages are PR 4.

The forum doesn't have a ton of incoming links, but it has a few. The archive is up and seems to be working properly. Everything else on my site is getting hit by google pretty much daily, but the new board has yet to be spidered. The last time google came round to the board was june 14th.

Any thoughts? If I'm forgetting important info, sorry. I hunted around a bit for this particular problem and didn't see it answered, so sorry if I'm duplicating a common request...

thanks
chris
Reply With Quote
  #2  
Old 06-20-2005, 09:11 PM
sarahk's Avatar
sarahk sarahk is offline
 
Join Date: Jun 2004
Location: Auckland, New Zealand
Posts: 64
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Can you index you board using Xenu? You should be able to. Then it's just a matter of time before the real spiders come visiting. Because they already come to the old part of the site they should come to the new part soon enough.

Put up links on the front page to the latest posts etc to drive new content. And get a google sitemap in there (and register it).
Reply With Quote
  #3  
Old 06-20-2005, 10:08 PM
maxpot maxpot is offline
 
Join Date: Jun 2005
Posts: 4
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Thanks for the sitemap tip. My provider doesn't permit me shell access right now, so until I get that straightened out ...

I guess I'm just confused as to why the spiders are coming to every other part of the site but ignoring the forum. Is there something inherent to vbulletin that repels spiders? I remember using the phpBB there was a bit of code to throw in the index that made spiders happy.

Anyhow, thanks for your help and I'll get the site map up as soon as I can

chris
Reply With Quote
  #4  
Old 06-20-2005, 10:12 PM
sarahk's Avatar
sarahk sarahk is offline
 
Join Date: Jun 2004
Location: Auckland, New Zealand
Posts: 64
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

The second link in my post is for a PHP script which will generate the sitemap for you - no need for shell access and when you register the feed with google you will be spidered and respidered regularly.

I have put up several vBulletin sites, without making huge efforts to send Google in, and have had no problems getting them done.

I'd look instead at any "stop" words on your forum or barriers in it's way.

Sarah
Reply With Quote
  #5  
Old 06-30-2005, 01:22 AM
yobajufa yobajufa is offline
 
Join Date: Jul 2003
Posts: 6
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Sarah,

If xenu can't spider my board, what do I do to fix that?

Thanks for the help.

Yobajufa
Reply With Quote
  #6  
Old 06-30-2005, 01:26 AM
sarahk's Avatar
sarahk sarahk is offline
 
Join Date: Jun 2004
Location: Auckland, New Zealand
Posts: 64
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

If Xenu can't then you have major problems as it just follows html links, and that's what your users are doing also.

What output does Xenu give you?
Reply With Quote
  #7  
Old 06-30-2005, 01:35 AM
yobajufa yobajufa is offline
 
Join Date: Jul 2003
Posts: 6
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

It just takes the idex with and with www and then says finished.

Yobajufa

Sarah,

Guests can view so is their any other reason you can think of why it can't get spidered by zenu?

Yobajufa
Reply With Quote
  #8  
Old 07-03-2005, 11:43 PM
sarahk's Avatar
sarahk sarahk is offline
 
Join Date: Jun 2004
Location: Auckland, New Zealand
Posts: 64
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

xenu happily munched through your site for me. You have some session id's turning up though and that's bad.

Sarah
Reply With Quote
Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 12:16 PM.


Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.05990 seconds
  • Memory Usage 2,225KB
  • Queries Executed 13 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)ad_showthread_beforeqr
  • (1)ad_showthread_firstpost
  • (1)ad_showthread_firstpost_sig
  • (1)ad_showthread_firstpost_start
  • (1)footer
  • (1)forumjump
  • (1)forumrules
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (1)navbar
  • (3)navbar_link
  • (120)option
  • (8)post_thanks_box
  • (8)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (8)post_thanks_postbit_info
  • (8)postbit
  • (8)postbit_onlinestatus
  • (8)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open
  • (1)tagbit_wrapper 

Phrase Groups Available:
  • global
  • inlinemod
  • postbit
  • posting
  • reputationlevel
  • showthread
Included Files:
  • ./showthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_postinfo_query
  • fetch_postinfo
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showthread_start
  • showthread_getinfo
  • forumjump
  • showthread_post_start
  • showthread_query_postids
  • showthread_query
  • bbcode_fetch_tags
  • bbcode_create
  • showthread_postbit_create
  • postbit_factory
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • fetch_musername
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • tag_fetchbit_complete
  • forumrules
  • navbits
  • navbits_complete
  • showthread_complete