Limit Viewing/Allow Spidering

[dano]

Originally Posted by dynamite

Well, it seemed to work, but then I started noticing some of the spiders were allowed and some were not. I haven't figured that one out yet, but in the process of the testing I managed to get my Google PR cut in half. I'm waiting for that to build back up, plus I am going to try this on a site that doesn't really matter about the PR. So if I do figure out anymore, then I will post an update.

Very cool, I look forward to the update. I have like 250 guests online right now, and I would really like to make them register.

[Zachery]

Originally Posted by dano

Very cool, I look forward to the update. I have like 250 guests online right now, and I would really like to make them register.

whats the point of having 50000 users with 500 posts?

id rather have a low member count with a high thread post count

[hadley]

I'll tell you the point:

I have a site with a ton more content than the forums alone, and forcing people to register is one way (via subsequent emails) to introduce them to other parts of the site that they may regard as more valuable than the forums. I want the same thing that Dynamite wants.

Yes, I do understand that most forums exist for discussion, but mine now contain two years of valuable content and expert advice -- many people are satisfied to read that Q&A exchange with experts, and don't see the need to post. However, I think it's fair that I ask them for their email address (with full opt-out privileges, of course), before I grant them access.

An example: Ordinarily, I wouldn't bother to make this post, because I know most of you don't care. But it bothers me that someone from the vB.com team would make a comment like "what's the point." In the real world of business, number of users is the point.

[Zachery]

Originally Posted by hadley

I'll tell you the point:

I have a site with a ton more content than the forums alone, and forcing people to register is one way (via subsequent emails) to introduce them to other parts of the site that they may regard as more valuable than the forums. I want the same thing that Dynamite wants.

Yes, I do understand that most forums exist for discussion, but mine now contain two years of valuable content and expert advice -- many people are satisfied to read that Q&A exchange with experts, and don't see the need to post. However, I think it's fair that I ask them for their email address (with full opt-out privileges, of course), before I grant them access.

An example: Ordinarily, I wouldn't bother to make this post, because I know most of you don't care. But it bothers me that someone from the vB.com team would make a comment like "what's the point." In the real world of business, number of users is the point.

If you allow spiders to spider your page, and display this info in a search engin, then anyone who googles your site could read it, without registering.

My comment stands valid