Luckily I could find the modification for it and it's done.
Thanx you both friends, for your help and support.
Edit: Sharing link, if any one is interested for it (Ban Spiders by User Agent)
https://vborg.vbsupport.ru/showthread.php?t=268208
G!
Quote:
Originally Posted by Max Taxable
What setishock says here is very important. Baidu is the most aggressive and useless bot out there. It does a forum no good at all to have them - what, do we think people in China are going to be searching us up? They do not obey robots.txt at all and they are essentially leeches. Blocking them is a must.
|