The Arcive of Official vBulletin Modifications Site.It is not a VB3 engine, just a parsed copy! |
|
#1
|
|||
|
|||
Can Private forum Locations Be crawled?
I know that when google spider and baidu etc, try to crawl a forum they dont have permission to enter they only see the permission denied page as seen on who's online.
But the fact that they are seeing the permission denied thing does that mean they will cache the location. For eg. I make a section called www.myforum.com/private-section I make the section hidden from view, I see google bot trying to crawl it, but seeing the no permission thing. Now google bot has been denied seeing the contents of that forum, but does google bot now know that the location exists? I want to make it so that the no-one even bots ever knows a private forum exists within my public forum. I know I can deny via the robots.txt but some bots choose to ignore that. How can I make sure of it? is permissions enough? Thanks for your help. --------------- Added [DATE]1346944839[/DATE] at [TIME]1346944839[/TIME] --------------- anyone know this? thanks |
|
|
X vBulletin 3.8.12 by vBS Debug Information | |
---|---|
|
|
More Information | |
Template Usage:
Phrase Groups Available:
|
Included Files:
Hooks Called:
|