Allow search engines to read the archive but not other logged out users
We want the site indexed but we dont allow non members to visit the site. It would be nice if the engines could get in and index everything but still not allow everyone else. Could we somehow check the user agent and if its a bot of some type, let them access the entire site to index it? This would help us with search engine placement but would still stop non members from viewing entire posts because once they click the link from the search engine they would be prompted to log in.
Can someone set me in the right direction for something like this?
03-28-2005, 03:00 AM
Allow search engines to read the archive but not other logged out users
Threaded Mode