Quote:
Originally Posted by Zia
www.boardtracker.com [this bot is very harmfull..that can even access every are..]
we needed to know that our site is being listed there or not....
|
BoardTracker is not 'harmful', it is a search engine for forums. Please take a closer look before making such assumptions. To know if your site is indexed (it isn't) simply search for it using 'site:domain.com'. BoardTracker is robots.txt compliant anyway so you can fully control access.