That dude has alot of garbage on his computer.

Use this tool http://user-agent-string.info/parse it will breakdown the UA in to its component parts :)

Thank you Simon... :)

Very useful ... :up:

Regards,
Doug

U da Man Simon.

Lol, thanks!, i try ;)

Yes, I ensured that the following was in my robots.txt file:

User-agent: Baiduspider
Disallow: /


Then I sent an email to: spiderhelp@baidu.com

Here is the message and reply I received:


I have not seen hide nor hair of Baidu since this was done, nearly a month ago.

To find the email address I went to their website, translated the page into English, and the searched Baidu Spider. Which took me to a search results page, which lead me to this page:
http://www.baidu.com/search/spider.html

I simply translated to English, and found the info I was looking for.

Baidu was the ONLY spider that was causing major issues, now I am able to use this add-on for other spiders - but Baidu was using massive amounts of resources.

Hope this helps.

Yes, thank you very much ... :)

Regards,
Doug

I have problems with Majestics MJ12bot. I tried to redirect bad spiders to own IP, or to HTML address given in mod. AFAIK all spiders other than Majestics MJ12bot are gone (here and there are new ones, but I remove them).

Do you know why this spider is successful in avoiding this mod?

When the spider appears next click the who's online, at the bottom choose show useragent and copy their entire UA string to the list :)

Thanks for the info. Before I didn't noticed this. I'll wait till it shows again (hopefully never again).

I also installed vB Bad Behavior: https://vborg.vbsupport.ru/showthread.php?t=261498

EDIT: I found this info about it:

Mozilla/5.0 (compatible; MJ12bot/v1.4.2; http://www.majestic12.co.uk/bot.php?+)

I now use only this string in spider list settings: MJ12bot.

I hope it will stop it, maybe Majestics MJ12bot was too much