Stopping guests, but allowing search engines?
 

on my forum we have stopped people viewing the cointent due to them other places taking info, and using it on there site, so what i did was stop guests from viewing the forum and content.

but i noticed when viewing "whos online" that google/ yahoo etc are all getting the "stop" messsage..
so now i need to know how i can stop guests, but allow search engines.

i have approved all the serch engines, and i have VBSEO also, but now they are getting the stop message, and i want them to be able to get my content..

any ideas?
Thanks. :)
Tom

Use a robot.txt file
See THIS LINK for details

thank you. :)

--------------- Added [DATE]1237892547[/DATE] at [TIME]1237892547[/TIME] ---------------

where di a create this txt file in admin?..
sorry im a noob..lol

I use Limited Guest Viewing to solve this issue... It allows bots but limits guests... I do have 1 or 2 boards not viewable by guests but if I don't want guests to visit them, I don't want them to appear in Google's search results... ya know?

As you do this, beware of cloaking