vb.org Archive - Search Bots

vb.org Archive (https://vborg.vbsupport.ru/index.php)

- vB3 General Discussions (https://vborg.vbsupport.ru/forumdisplay.php?f=111)

- - Search Bots (https://vborg.vbsupport.ru/showthread.php?t=69429)

Milesian

09-14-2004 09:34 AM

Search Bots

As yet, only MSN has spidered my forum.
On my old phpBB2 forum, Google automatically spidered it but no sign of it yet on my vBulletin 3.0.3 forum.

Is there something I need to do to encourage it or simply wait?

TCB	09-14-2004 01:51 PM

Did you install the board on a new domain, or on the same where you had the phpbb2 messageboard? And when was the last time a spider visited your site?

These are my 'Robots/Spiders visitors' stat:

Code:

MSNBot (hits: 5593) - (last: 13 Sep 2004 - 23:48)

Inktomi Slurp (hits: 900) - (last: 14 Sep 2004 - 00:07)

Unknown robot (identified by 'crawl') (hits: 181) - (last: 09 Sep 2004 - 07:09)

MSIECrawler (hits: 82) - (last: 13 Sep 2004 - 05:32)

Googlebot (Google) (hits: 63) - (last: 13 Sep 2004 - 22:02)

Jeeves (hits: 34) - (last: 04 Sep 2004 - 09:33)

Alexa (IA Archiver) (hits: 15) - (last: 05 Sep 2004 - 02:11)

Turn It In (hits: 10) - (last: Sep 2004 - 02:39)

GigaBot (hits: 6) - (last: 13 Sep 2004 - 05:32)

arks (hits: 3) - (last: 07 Sep 2004 - 12:13)

And don't forget to enable your archive (www.yourdomain.com/archive/), that will help you get indexed by spiders easier

Milesian

09-15-2004 10:06 AM

Yeah, it's where the old phpBB2 board was located.
I don't have a stats hack installed yet so I'm not sure about the bot statistics. The only one's I've seen so far are MSN bots (I submitted the site to them).

The archive is also enabled.
I guess they just haven't found the forum yet :(

TCB	09-15-2004 10:28 AM

Only my index page can be found on google (and non vbulletin folders and pages), but none of the forumthreads can be found on google. There are vbulletin sites that where all threads are indexed by Google. So I guess it probably has something to do with just being lucky

MPM.com

11-14-2004 08:35 PM

The same thing on my site, I have used to have lots of listings on google, now only the home page.

TCB where did you find these stats? How is it possible to find out which bot is which?

Thanks
Mark

All times are GMT. The time now is 11:49 PM.

X vBulletin 3.8.12 by vBS Debug Information
Page Generation 0.01077 seconds Memory Usage 1,718KB Queries Executed 10 (?)
More Information
Template Usage: (1)ad_footer_end (1)ad_footer_start (1)ad_header_end (1)ad_header_logo (1)ad_navbar_below (1)bbcode_code_printable (1)footer (1)gobutton (1)header (1)headinclude (6)option (1)post_thanks_navbar_search (1)printthread (5)printthreadbit (1)spacer_close (1)spacer_open Phrase Groups Available: global postbit showthread	Included Files: ./printthread.php ./global.php ./includes/init.php ./includes/class_core.php ./includes/config.php ./includes/functions.php ./includes/class_hook.php ./includes/modsystem_functions.php ./includes/class_bbcode_alt.php ./includes/class_bbcode.php ./includes/functions_bigthree.php Hooks Called: init_startup init_startup_session_setup_start init_startup_session_setup_complete cache_permissions fetch_threadinfo_query fetch_threadinfo fetch_foruminfo style_fetch cache_templates global_start parse_templates global_setup_complete printthread_start bbcode_fetch_tags bbcode_create bbcode_parse_start bbcode_parse_complete_precache bbcode_parse_complete printthread_post printthread_complete
Messages: