Google crawler
Hi everybody
Appart from robots.txt in the root directory, is there any other place in admincp that I can block spiders for crawling specific forums
My question is because I have a forum that dont appear on google searches, maybe the old administrator block this forum from crawling but the strange thing is that I dont have robots.txt in the root directory, thats mean google is 100% opened to crwal the site
Where in admincp can block spiders for crawling specific forums?
Thanks in advance
|