vb.org Archive
Page 2 of 2 1 2
Show 40 post(s) from this thread on one page

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   Modification Requests/Questions (Unpaid) (https://vborg.vbsupport.ru/forumdisplay.php?f=112)
-   -   A robots.txt for vB3 RC2 please? (https://vborg.vbsupport.ru/showthread.php?t=60011)

Dave-ahfb 01-11-2004 06:35 PM
Quote:
Originally Posted by Faranth
yes they do
And the spider is? Maybe you can share a little more info.

Dave

Zachery 01-11-2004 06:43 PM
yahoo uses Inktomi which is the yahoo spider...

Dave-ahfb 01-11-2004 07:09 PM
I know Ink spiders, but as of yet this is not used on the Yahoo site. Can you show me a SERP on Yahoo which is Inktomi and not Google?

In the next few months, what you say is true. Yahoo will not be renewing with Google and will replace it with what we know as Inktomi. Currently, as far as I know, it is all Google or Yahoo directory.

Dave

Zach 05-13-2004 04:13 PM
just fyi I am sure all know this, but just in case - yahoo uses their own now :) (only posted this just in case someobody read this and didnt realize it was old)

Zach 05-13-2004 04:16 PM
Disallow: /forums/archive/

?Why?

Boofo 05-13-2004 04:23 PM
Quote:
Originally Posted by Zach
Disallow: /forums/archive/


?Why?
That shouldn't be in there.


All times are GMT. The time now is 10:13 AM.
Page 2 of 2 1 2
Show 40 post(s) from this thread on one page

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01549 seconds
  • Memory Usage 1,715KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (2)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (1)pagenav_pagelink
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (6)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 
Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 
Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete