The Arcive of Official vBulletin Modifications Site.It is not a VB3 engine, just a parsed copy! |
|
#1
|
|||
|
|||
No more spider visits. What is wrong? Please help.
Hello.
I have a had a strange thing happening to me. I run a vbulletin forum and when I checked this morning I noticed that there where no visits by spiders (Yahoo, Google, etc) since the early hours of the 7th. And this seems to continue. I only have my visitors but no spiders. This is my forum URL: http://www.sustainabilityforum.com/forum I am running 3.6.7 PL1 and use the Whos is online mod and the country display for Whos online. I did not make any changes that could have caused this. I also run vbseo and doe xml sitemaps that which was successfully send to google this morning. Does anyone have an idea what could have caused this or has anyone had the same issue? Please help! Thanks. Fabian |
#2
|
||||
|
||||
Are you using the Spider Display mod?
|
#3
|
|||
|
|||
HI.
I am using this mod: https://vborg.vbsupport.ru/showthread.php?t=131314 And I have another mistery that I have a robots.txt being displayed but I never did a robots file but it still shows up: http://www.sustainabilityforum.com/robots.txt/ And it says to disallow siders. But I dont want that. Waht can I do? And where can I find this robot file? Thanks. Fabian |
#4
|
||||
|
||||
Quote:
|
#5
|
|||
|
|||
Hi Lynne.
Yes, I have looked for the folder robots.txt but there is none on the root directory or anywhere else. I have looked through every file. In ftp it needs to be under "/" right as a .txt right? Thanks. Fabian |
#6
|
||||
|
||||
It is not a folder. It should be at the same level as your "forum" folder though. And it is called "robots.txt"
|
|
|
X vBulletin 3.8.12 by vBS Debug Information | |
---|---|
|
|
More Information | |
Template Usage:
Phrase Groups Available:
|
Included Files:
Hooks Called:
|