[CAG CheechDogg]

Originally Posted by Gadget_Guy

I have implemented your list.

In regards to your comment about "my list".... I have no idea to be honest.

Those I put in there based on what I was seeing in my WOL and putting things in there to try and block them.

I am sure I was way off base and incorrect in doing so.

So.... in light of this... if you want to provide a "proper" list... I am happy to take your guidance.

I don't know the first thing about any of this stuff and am looking to experts like yourself to assist.

D.

Gadge my Man... what you need to do is ask yourself a few questions ... like how much do rankings mean to you, if you want every single search engine to crawl your site ... are you on a shared or dedicated server and if you are already having problems with bots and especially bad bots hitting your site too much ..

I for one don't care for any other search engine except for google and yahoo ... I have completely blocked most search engines that are foreign and facebook as well ... as you can see from the screenshot I only have like 10 different spiders/bots that even crawl my site and that is just how I want it ...

So put together a list of the engines and spiders that you know are giving you hell then you can add those to the list that I have or Simon and Ozzy have and you can give it one last look and just remove the ones you want your site to be crawled with ....

I added my list in a txt file if you want to try mine out and see how it works for you ...

Here it is as well ...