Go Back   vb.org Archive > vBulletin 3 Discussion > vB3 General Discussions
Reload this Page No more spider visits. What is wrong? Please help.
FAQ Community Calendar Today's Posts Search

Reply
 
Thread Tools Display Modes
  #1  
Old 06-08-2008, 10:51 AM
fpattberg fpattberg is offline
 
Join Date: Jan 2007
Location: UK
Posts: 64
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default No more spider visits. What is wrong? Please help.
Hello.

I have a had a strange thing happening to me. I run a vbulletin forum and when I checked this morning I noticed that there where no visits by spiders (Yahoo, Google, etc) since the early hours of the 7th. And this seems to continue. I only have my visitors but no spiders.

This is my forum URL: http://www.sustainabilityforum.com/forum

I am running 3.6.7 PL1 and use the Whos is online mod and the country display for Whos online. I did not make any changes that could have caused this. I also run vbseo and doe xml sitemaps that which was successfully send to google this morning.

Does anyone have an idea what could have caused this or has anyone had the same issue?

Please help!

Thanks.

Fabian
Reply With Quote
  #2  
Old 06-08-2008, 11:12 AM
Boofo's Avatar
Boofo Boofo is offline
 
Join Date: Mar 2002
Location: Des Moines, IA (USA)
Posts: 15,776
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default
Are you using the Spider Display mod?
Reply With Quote
  #3  
Old 06-08-2008, 12:41 PM
fpattberg fpattberg is offline
 
Join Date: Jan 2007
Location: UK
Posts: 64
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default
HI.

I am using this mod: https://vborg.vbsupport.ru/showthread.php?t=131314

And I have another mistery that I have a robots.txt being displayed but I never did a robots file but it still shows up: http://www.sustainabilityforum.com/robots.txt/

And it says to disallow siders. But I dont want that.

Waht can I do? And where can I find this robot file?

Thanks.
Fabian
Reply With Quote
  #4  
Old 06-08-2008, 01:30 PM
Lynne's Avatar
Lynne Lynne is offline
 
Join Date: Sep 2004
Location: California/Idaho
Posts: 41,180
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default
Quote:
Originally Posted by fpattberg View Post
HI.

I am using this mod: https://vborg.vbsupport.ru/showthread.php?t=131314

And I have another mistery that I have a robots.txt being displayed but I never did a robots file but it still shows up: http://www.sustainabilityforum.com/robots.txt/

And it says to disallow siders. But I dont want that.

Waht can I do? And where can I find this robot file?

Thanks.
Fabian
It looks like the robots.txt file is located in your root directory. Just login via ftp and remove it. You might want to try to find out who put that there though if you didn't.
Reply With Quote
  #5  
Old 06-08-2008, 01:53 PM
fpattberg fpattberg is offline
 
Join Date: Jan 2007
Location: UK
Posts: 64
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default
Hi Lynne.

Yes, I have looked for the folder robots.txt but there is none on the root directory or anywhere else. I have looked through every file.

In ftp it needs to be under "/" right as a .txt right?

Thanks.
Fabian
Reply With Quote
  #6  
Old 06-08-2008, 02:04 PM
Lynne's Avatar
Lynne Lynne is offline
 
Join Date: Sep 2004
Location: California/Idaho
Posts: 41,180
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default
It is not a folder. It should be at the same level as your "forum" folder though. And it is called "robots.txt"
Reply With Quote
Reply

« Previous Thread | Next Thread »

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump


All times are GMT. The time now is 02:44 AM.

Contact Us - Archive - Top

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2024, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.04337 seconds
  • Memory Usage 2,206KB
  • Queries Executed 11 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)ad_showthread_beforeqr
  • (1)ad_showthread_firstpost
  • (1)ad_showthread_firstpost_sig
  • (1)ad_showthread_firstpost_start
  • (1)bbcode_quote
  • (1)footer
  • (1)forumjump
  • (1)forumrules
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (1)navbar
  • (3)navbar_link
  • (120)option
  • (6)post_thanks_box
  • (6)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (6)post_thanks_postbit_info
  • (6)postbit
  • (6)postbit_onlinestatus
  • (6)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open
  • (1)tagbit_wrapper 
Phrase Groups Available:
  • global
  • inlinemod
  • postbit
  • posting
  • reputationlevel
  • showthread
Included Files:
  • ./showthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_post_thanks.php 
Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showthread_start
  • showthread_getinfo
  • forumjump
  • showthread_post_start
  • showthread_query_postids
  • showthread_query
  • bbcode_fetch_tags
  • bbcode_create
  • showthread_postbit_create
  • postbit_factory
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • fetch_musername
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • tag_fetchbit_complete
  • forumrules
  • navbits
  • navbits_complete
  • showthread_complete