Log in

View Full Version : SE Spider Access to restricted forums


jredrum
06-24-2008, 12:38 AM
I want to allow search engine spiders into a restricted access forum. Is there a way to do that while keeping guests and regular users out?

Or a way to change the permissions for spiders?

Dismounted
06-24-2008, 07:38 AM
I believe this violates Google's TOS.

KURTZ
06-24-2008, 07:42 AM
this is an interesting thing, i've enabled the 'snap shots' onto my board and i saw that their spiders (i follow them into who's online) reads my hidden areas ...

Marco van Herwaarden
06-24-2008, 10:05 AM
Offering different content to regular visitors and SE Spiders is considerd cloaking by most SE's and might get your site removed from their listings.

jredrum
06-24-2008, 01:24 PM
Offering different content to regular visitors and SE Spiders is considerd cloaking by most SE's and might get your site removed from their listings.

Ah, well don't want that.

I was just trying to setup an RSS feed for my other site that would be in the adult section of my board, which reg users and guests can't see.

I could see how that would be considered cloaking though.

Thanks for the heads up!