inktomisearch.com

[shoppingtelly]

I have had inktomisearch.com going through all the threads on my board and doing Moderating Duties, Memberlists etc, is there a hack that I can add to stop them from searching the board and eating up my Bandwidth.

Many thanks

[amykhar]

you don't need a hack. You just need to modify your robots.txt file.

Amy

[shoppingtelly]

Thank you Amy, where would I find out how to do this?

thanks again

[assassingod]

<a href="https://vborg.vbsupport.ru/showthread.php?s=&threadid=48698&highlight=robot" target="_blank">https://vborg.vbsupport.ru/showt...ighlight=robot</a>

That hack may help you.

[noppid]

Try a simple meta tag in your header...

<meta name="robots" content="index,nofollow">

This will tell the search engine robot to add you to the listing but not to follow any links it finds.

If you don't want to be included in the search index change index to noindex.

[noppid]

Follow Up:

Inktomi found us. They have been on the forum for 4 days now. There are always at least 10 bots and sometimes as many as 35. We have been optimizing to attract the search engine bots as opposed to the point of this thread to slow them down. For a high graphics site I bet this can amount to quite a bit of bandwidth usage.

I hope it pays off in index listings.