The Arcive of Official vBulletin Modifications Site.It is not a VB3 engine, just a parsed copy! |
|
#1
|
|||
|
|||
What Robot txt should i have? Google Webmaster blocking 11 000 URL
I wonder what google Robot.txt i should i have. At the moment i have a Robot.txt but in the root it is just blocking my wordpress that i have on blog.domain.com.
Google webmaster is blocking this kind of threads /tags.php?tag=investment+in+thailand URL restricted by robots.txt /threads/2207-Obama-Visit-To-Indonesia?p=2389 URL restricted by robots.txt Should the VB block these? |
#2
|
||||
|
||||
so you're asking if you should blog tags or one thread?
you can look at mine as an example.... |
#3
|
|||
|
|||
I do not even have a robot for my VB and i do not know why it blocking these URL there is 11 000 now. I see you not blocking tags and threads.
|
Thread Tools | |
Display Modes | |
|
|
X vBulletin 3.8.12 by vBS Debug Information | |
---|---|
|
|
More Information | |
Template Usage:
Phrase Groups Available:
|
Included Files:
Hooks Called:
|