Stopping guests, but allowing search engines?

[findmeareptile]

on my forum we have stopped people viewing the cointent due to them other places taking info, and using it on there site, so what i did was stop guests from viewing the forum and content.

but i noticed when viewing "whos online" that google/ yahoo etc are all getting the "stop" messsage..
so now i need to know how i can stop guests, but allow search engines.

i have approved all the serch engines, and i have VBSEO also, but now they are getting the stop message, and i want them to be able to get my content..

any ideas?
Thanks. :)
Tom

[stonesy]

Use a robot.txt file
See THIS LINK (http://www.javascriptkit.com/howto/robots.shtml) for details

[findmeareptile]

thank you. :)

--------------- Added 1237892547 at 1237892547 ---------------

where di a create this txt file in admin?..
sorry im a noob..lol

[BlueNinjaGo]

I use Limited Guest Viewing (https://vborg.vbsupport.ru/showthread.php?t=178720&highlight=limit+guests)to solve this issue... It allows bots but limits guests... I do have 1 or 2 boards not viewable by guests but if I don't want guests to visit them, I don't want them to appear in Google's search results... ya know?

[GTAce]

As you do this, beware of cloaking (http://en.wikipedia.org/wiki/Cloaking)