The Arcive of Official vBulletin Modifications Site.It is not a VB3 engine, just a parsed copy! |
|
#1
|
|||
|
|||
Question: Robots.txt File
Is there anything that I've disallowed that will hurt me as far my rankings in Google?
Quote:
|
#2
|
||||
|
||||
Leave your admincp, modcp out of the robots.txt file, those are areas you don't even want the bots to know where they are ...
If anything put a htacess password on them |
#3
|
|||
|
|||
Thanks, didn't think about that.
|
Благодарность от: | ||
CAG CheechDogg |
#4
|
||||
|
||||
Hello, feel free to include your sitemap at the end of the robots.txt.
Also, it is better to add something like this at the top, since we know google bot's name. Code:
User-agent: Mediapartners-Google Disallow: User-agent: * Crawl-delay: 30 Add your list here. Sitemap: http://sitemapurl |
Благодарность от: | ||
CAG CheechDogg |
|
|
X vBulletin 3.8.12 by vBS Debug Information | |
---|---|
|
|
More Information | |
Template Usage:
Phrase Groups Available:
|
Included Files:
Hooks Called:
|