The Arcive of Official vBulletin Modifications Site.It is not a VB3 engine, just a parsed copy! |
|
#1
|
||||
|
||||
Yahoo Slurp Invasion!
Yahoo! Slurp Spiders (1007), MSNBot Spiders (11), Google Spiders (1)
And thats with a robots.txt of: User-agent: Slurp Crawl-delay: 60 Yahoo needs to be taken out behind the wood shed and beaten to a pulp for this BS. _V |
#2
|
|||
|
|||
yahoo slurps often because you have a popular topic... no matter the robots.txt ...
and i suppose it will come with a non-robot taff soon, because they are trying to overcome google... |
#3
|
||||
|
||||
Wow, send some of those to me, LOL
|
#4
|
||||
|
||||
Up to since last posting: Yahoo! Slurp Spiders (1067), MSNBot Spiders (11), Google Spiders (1) You can have them all, please take them. _V |
#5
|
||||
|
||||
Why are you complaining? the more bots the better.
|
#6
|
||||
|
||||
I have about 100 of them online now; for the day would be over 2000 for sure.
I don't mind they do not seem to take up much resources. Are you feeling an impact? |
#7
|
|||
|
|||
its there r somthing do to get like u friends?
|
#8
|
||||
|
||||
Slurpies always visit in packs, one of the forums I admin gets over 2000 a day.
Quote:
|
#9
|
|||
|
|||
Thats alot of spiders =o
|
#10
|
||||
|
||||
Quote:
It just smells of desperation for Yahoo to be flooding the web with that many spiders. _V |
|
|
X vBulletin 3.8.12 by vBS Debug Information | |
---|---|
|
|
More Information | |
Template Usage:
Phrase Groups Available:
|
Included Files:
Hooks Called:
|