If you want to get rid of 99% of the yahoo bot spiders, either use iptables or an htaccess file with a deny host and kill off this ip block 74.6.0.0/16 leave the other ip block yahoo uses for the spiders open, you wont get but 10 to 20 of them at that point.
You should setup a robots.txt file as well, might take yahoo a few days to start following the rules set in the robots file.
|