Go Back   vb.org Archive > Community Central > Community Lounge
FAQ Community Calendar Today's Posts Search

Reply
 
Thread Tools Display Modes
  #1  
Old 06-10-2007, 12:33 AM
ShawnV's Avatar
ShawnV ShawnV is offline
 
Join Date: Mar 2005
Posts: 270
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default Yahoo Slurp Invasion!

Yahoo! Slurp Spiders (1007), MSNBot Spiders (11), Google Spiders (1)

And thats with a robots.txt of:

User-agent: Slurp
Crawl-delay: 60

Yahoo needs to be taken out behind the wood shed and beaten to a pulp for this BS.

_V
Reply With Quote
  #2  
Old 06-10-2007, 01:29 AM
nexialys
Guest
 
Posts: n/a
Default

yahoo slurps often because you have a popular topic... no matter the robots.txt ...

and i suppose it will come with a non-robot taff soon, because they are trying to overcome google...
Reply With Quote
  #3  
Old 06-10-2007, 01:37 AM
HMBeaty's Avatar
HMBeaty HMBeaty is offline
 
Join Date: Sep 2005
Posts: 4,141
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Wow, send some of those to me, LOL
Reply With Quote
  #4  
Old 06-10-2007, 02:25 AM
ShawnV's Avatar
ShawnV ShawnV is offline
 
Join Date: Mar 2005
Posts: 270
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by Redlinemotorsports View Post
Wow, send some of those to me, LOL

Up to since last posting: Yahoo! Slurp Spiders (1067), MSNBot Spiders (11), Google Spiders (1)

You can have them all, please take them.

_V
Reply With Quote
  #5  
Old 06-10-2007, 03:21 AM
no mods's Avatar
no mods no mods is offline
 
Join Date: Apr 2007
Posts: 488
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Why are you complaining? the more bots the better.
Reply With Quote
  #6  
Old 06-10-2007, 03:54 AM
theFAILURE's Avatar
theFAILURE theFAILURE is offline
 
Join Date: Jan 2005
Posts: 141
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

I have about 100 of them online now; for the day would be over 2000 for sure.

I don't mind they do not seem to take up much resources.

Are you feeling an impact?
Reply With Quote
  #7  
Old 06-10-2007, 04:18 AM
Ba$im Ba$im is offline
 
Join Date: Apr 2007
Location: Saudi Arabia
Posts: 167
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

its there r somthing do to get like u friends?
Reply With Quote
  #8  
Old 06-10-2007, 10:03 AM
Paul M's Avatar
Paul M Paul M is offline
 
Join Date: Sep 2004
Location: Nottingham, UK
Posts: 23,748
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Slurpies always visit in packs, one of the forums I admin gets over 2000 a day.

Quote:
Visitors (5,540), Yahoo! Slurp Spiders (2,304), Google Spiders (11), AltaVista Spiders (1), AskJeeves Spiders (2), MSNBot Spiders (15), Google AdSense Spiders (1)
Reply With Quote
  #9  
Old 06-10-2007, 11:27 AM
Frozen Tears Frozen Tears is offline
 
Join Date: Nov 2006
Posts: 46
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Thats alot of spiders =o
Reply With Quote
  #10  
Old 06-10-2007, 11:56 AM
ShawnV's Avatar
ShawnV ShawnV is offline
 
Join Date: Mar 2005
Posts: 270
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by Paul M View Post
Slurpies always visit in packs, one of the forums I admin gets over 2000 a day.
Seems so, I broke 2,873 Slurps last night, guess it doesn't really matter they cant be using up that many resources.

It just smells of desperation for Yahoo to be flooding the web with that many spiders.

_V
Reply With Quote
Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 04:56 AM.


Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2024, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.07531 seconds
  • Memory Usage 2,251KB
  • Queries Executed 13 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)ad_showthread_beforeqr
  • (1)ad_showthread_firstpost
  • (1)ad_showthread_firstpost_sig
  • (1)ad_showthread_firstpost_start
  • (3)bbcode_quote
  • (1)footer
  • (1)forumjump
  • (1)forumrules
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (1)navbar
  • (3)navbar_link
  • (120)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (2)pagenav_pagelink
  • (10)post_thanks_box
  • (10)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (10)post_thanks_postbit_info
  • (10)postbit
  • (9)postbit_onlinestatus
  • (10)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open
  • (1)tagbit_wrapper 

Phrase Groups Available:
  • global
  • inlinemod
  • postbit
  • posting
  • reputationlevel
  • showthread
Included Files:
  • ./showthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_postinfo_query
  • fetch_postinfo
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showthread_start
  • showthread_getinfo
  • forumjump
  • showthread_post_start
  • showthread_query_postids
  • showthread_query
  • bbcode_fetch_tags
  • bbcode_create
  • showthread_postbit_create
  • postbit_factory
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • fetch_musername
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • pagenav_page
  • pagenav_complete
  • tag_fetchbit_complete
  • forumrules
  • navbits
  • navbits_complete
  • showthread_complete