vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vB4 General Discussions (https://vborg.vbsupport.ru/forumdisplay.php?f=251)
-   -   Google crawler (https://vborg.vbsupport.ru/showthread.php?t=324298)

fernandofgg 01-26-2017 05:08 PM

Google crawler
 
Hi everybody

Appart from robots.txt in the root directory, is there any other place in admincp that I can block spiders for crawling specific forums

My question is because I have a forum that dont appear on google searches, maybe the old administrator block this forum from crawling but the strange thing is that I dont have robots.txt in the root directory, thats mean google is 100% opened to crwal the site

Where in admincp can block spiders for crawling specific forums?

Thanks in advance

bzcomputers 01-26-2017 09:18 PM

Check to see if you have this mod installed: https://vborg.vbsupport.ru/showthread.php?t=268208

...or the site could have been blacklisted in the past for any number of reasons.

webmastersun 01-29-2017 03:39 AM

Quote:

Originally Posted by fernandofgg (Post 2581381)
Hi everybody

Appart from robots.txt in the root directory, is there any other place in admincp that I can block spiders for crawling specific forums

My question is because I have a forum that dont appear on google searches, maybe the old administrator block this forum from crawling but the strange thing is that I dont have robots.txt in the root directory, thats mean google is 100% opened to crwal the site

Where in admincp can block spiders for crawling specific forums?

Thanks in advance

Go to Forum manager and click on a forum.

At Posting Options box

Index New Posts in Search Engine
(Setting this to 'No' will prevent anyone from being able to search in this forum)

This should be set for private forums.


All times are GMT. The time now is 09:58 PM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01084 seconds
  • Memory Usage 1,711KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (3)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete