The Arcive of Official vBulletin Modifications Site.It is not a VB3 engine, just a parsed copy! |
|
|
#1
|
|||
|
|||
![]()
they sent me these instructions to do
You can also prevent robots from crawling parts of your site, while allowing them to crawl other sections. The following example would request search engines and robots not to crawl the cgi-bin folder, the tmp folder, and the junk folder and everything in those folders on your website. If you want to stop bots from visiting you site and stop search engines from ranking you, use this code: #Code to not allow any search engines! User-agent: * Disallow: / 2nd choice which i used and iam asking is this enough # Blocks robots from specific folders / directories User-agent: * Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: /junk/ |
![]() |
Thread Tools | |
Display Modes | |
|
|
X vBulletin 3.8.12 by vBS Debug Information | |
---|---|
|
|
![]() |
|
Template Usage:
Phrase Groups Available:
|
Included Files:
Hooks Called:
|