The Arcive of Official vBulletin Modifications Site.It is not a VB3 engine, just a parsed copy! |
|
#1
|
|||
|
|||
what's the easiest way to spider?
What's the easiest way to get spiders (search engines) to ONLY archive the archive portion of a site and not actually index any of the normal pages?
suggestions about this maybe? What's the best way for spiders to index or what not? I don't want to just simply set noindex to all the pages, but is there an extension out there or a plugin that will help me with this? thanks!! |
#2
|
|||
|
|||
noindex will work.
|
#3
|
||||
|
||||
can I ask why on earth you would want to do this ?
seems a bit counter-productive to me. cheers -Bs |
#4
|
|||
|
|||
Saves from duplicate content.
|
Thread Tools | |
Display Modes | |
|
|
X vBulletin 3.8.12 by vBS Debug Information | |
---|---|
|
|
More Information | |
Template Usage:
Phrase Groups Available:
|
Included Files:
Hooks Called:
|