vb.org Archive
Page 2 of 5 1 2 34 Last »
Show 40 post(s) from this thread on one page

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   Community Lounge (https://vborg.vbsupport.ru/forumdisplay.php?f=13)
-   -   Yahoo Slurp Invasion! (https://vborg.vbsupport.ru/showthread.php?t=149331)

Guest210212002 06-10-2007 03:51 PM
Quote:
Originally Posted by no mods (Post 1265258)
Why are you complaining? the more bots the better.:)
I once had 2000+ slurps on my server. When you run a big site, and you have 2000+ bots sucking up resources and queries it's certainly NOT a good thing.

Quote:
Originally Posted by Paul M (Post 1265395)
Slurpies always visit in packs, one of the forums I admin gets over 2000 a day.
Today for me:

Quote:
Visitors (2050), Yahoo! Slurp Spiders (1967), Google Spiders (6), MSNBot Spiders (12), AltaVista Spiders (1), AskJeeves Spiders (1), Google AdSense Spiders (1)
2000 slurps over the course of a day, sure. 2000 slurps at once, ack!

ShawnV 06-12-2007 11:25 PM
Anyone running an updated spiders_vbulletin.xml file they would care to share?

_V

MRGTB 06-13-2007 02:53 AM
Mmmmm, I seem to be getting MSN Bots acting like Slurps, in fact Yahoo been a good little boy on my site.

SO FAR! :erm:

ThunderVamp9 06-13-2007 12:57 PM
Yahoo Slurp Spiders have also been running amok on my site, eating up my bandwidth like it was the juices from an insect victim in its web.

Code:
Robots/Spiders visitors         
Robots                          Hits                  Bandwidth                  Last visit
Yahoo Slurp              11763+1054        145.17 MB        12 Jun 2007 - 17:53
Googlebot                5346+16              49.91 MB            12 Jun 2007 - 17:53
MSNBot                          205+125                7.90 MB              12 Jun 2007 - 12:03
Voila                          83+85                      1.32 MB            12 Jun 2007 - 15:40
Ask                      41+18                    676.06 KB          12 Jun 2007 - 17:48
MSNBot-media                1+18                      10.95 KB            11 Jun 2007 - 13:14
Alexa (IA Archiver)          1+1                        23.72 KB        08 Jun 2007 - 21:11
Lycos                            1+1                      23.03 KB            10 Jun 2007 - 07:33
Scooter                    0+1                    609 Bytes            09 Jun 2007 - 04:53

inteller2k7 06-15-2007 09:48 PM
Where could i get me one of this spiders is that a hack or is that something u have to do to the forums could someone explain i just got ma forums up
aioforums.com

Zachariah 06-16-2007 12:00 AM
Ya they poke their head out a bit.

Code:
Googlebot        91838+48        374.35 MB        14 Jun 2007 - 23:51
Inktomi Slurp        25600+2976        210.15 MB        14 Jun 2007 - 23:57
Google AdSense        3784+9        27.17 MB        14 Jun 2007 - 23:20
MSNBot        1987+406        63.68 MB        14 Jun 2007 - 23:46

Digbijoy 06-25-2007 09:05 AM
Quote:
Originally Posted by ThunderVamp9 (Post 1267630)
Yahoo Slurp Spiders have also been running amok on my site, eating up my bandwidth like it was the juices from an insect victim in its web.
Yeah.

And apart from eating the b/w,
just think of those innumerable queries that are made while indexing those pages. :eek:
oo....

But still, we shouldn't mind those spiders/bots/slurps.
Tell me who doesn't want his pages getting indexed by top ranked search engines. ?

pipin 06-26-2007 08:43 AM
Quote:
Visitors (5.163), Yahoo! Slurp Spiders (2.696), Google Spiders (4), AskJeeves Spiders (1), MSNBot Spiders (12)
well, they dont impact our speed ( me pats the dual 290 opteron combo) but the only thing i care, is that they blow up the user online statistics.

is there a way to exclude the spiders from that?

loonytune15 06-26-2007 09:12 AM
i just wish i could get my google spiders on my site..

Marcimi 06-30-2007 02:40 PM
I'm just running a small board used by a couple of ppls (usually around 20 ppl's) but that Yahoo-Thing tries to explode my b/w and my statistics.

I tried to exclude them with an updated robot.txt but nothing happens :/

Is there another way to exclude them? We do not have any public informations that is good enough to be listed on yahoo (or another search engine).


All times are GMT. The time now is 06:53 PM.
Page 2 of 5 1 2 34 Last »
Show 40 post(s) from this thread on one page

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.04073 seconds
  • Memory Usage 1,744KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (2)bbcode_code_printable
  • (5)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (3)pagenav_pagelink
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (10)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 
Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 
Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete