![]() |
SE Spider access
I don't know if this is possible or not.
I have a VIP section of my site that is for paying memebers. You get access to hundreds of articles. But your access needs to be upgraded. I was wondering if it would be possible to grant the SE spiders access to this area to spider all these articles for search engines. Now I guess when a visitor in the SE clicks the link it will say they can't access the page, but it would still be listed. Is this possible? |
up.
|
It is possible, but if your visitor change his HTTP USER AGENT header to header of SE he will see all of articles.
|
I don't really understand what that means?
|
This is against Google's TOS. You're not allow to spider content which is not readily available to all users.
|
All times are GMT. The time now is 04:09 AM. |
Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information | |
---|---|
|
|
![]() |
|
Template Usage:
Phrase Groups Available:
|
Included Files:
Hooks Called:
|