Go Back   vb.org Archive > vBulletin 4 Discussion > vB4 General Discussions
FAQ Community Calendar Today's Posts Search

Reply
 
Thread Tools Display Modes
  #11  
Old 03-31-2014, 12:26 AM
Max Taxable's Avatar
Max Taxable Max Taxable is offline
 
Join Date: Feb 2011
Posts: 3,134
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by booble View Post
Aha ok ok, but if I dont install it and only hidden all subforums for unregistered... google show threads etc?:erm:
Google typically obeys robots.txt and will not index you at all if you follow Ozzy's instructions on that.
Reply With Quote
  #12  
Old 03-31-2014, 12:30 AM
ozzy47's Avatar
ozzy47 ozzy47 is offline
 
Join Date: Jul 2009
Location: USA
Posts: 10,929
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

I would be willing to bet you could add this to the very top of your .htaccess file, and it should do it also,
Code:
Header set X-Robots-Tag "noindex, nofollow"
Reply With Quote
2 благодарности(ей) от:
booble, RichieBoy67
  #13  
Old 03-31-2014, 12:33 AM
Max Taxable's Avatar
Max Taxable Max Taxable is offline
 
Join Date: Feb 2011
Posts: 3,134
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by booble View Post
Aha ok ok, but if I dont install it and only hidden all subforums for unregistered... google show threads etc?:erm:
What actually are you wanting to do? Because if you have hidden forums, threads, or any other areas of your site that require login to view, google and all other spiders, cannot index them. Because they cannot see them.

If you block spiders completely or command 'no index nofollow' you will not show up in searches and makes it difficult for people to ever find your site.
Reply With Quote
  #14  
Old 03-31-2014, 12:38 AM
Max Taxable's Avatar
Max Taxable Max Taxable is offline
 
Join Date: Feb 2011
Posts: 3,134
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

With Bop5's mod here, you can also hide individual threads from the unregistered/not logged in usergroup and this includes all spiders. This hides threads you designate regardless of what forum they are in, or of existing permissions.
Reply With Quote
  #15  
Old 03-31-2014, 12:42 AM
booble booble is offline
 
Join Date: Apr 2012
Posts: 90
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by Max Taxable View Post
What actually are you wanting to do? Because if you have hidden forums, threads, or any other areas of your site that require login to view, google and all other spiders, cannot index them. Because they cannot see them.
aahh ok, Its perfect then. This is my doubt. Further I will install the mod...

On the future,within a time If I unninstall this mod and I want index, there is any problem?
Reply With Quote
  #16  
Old 03-31-2014, 12:44 AM
Max Taxable's Avatar
Max Taxable Max Taxable is offline
 
Join Date: Feb 2011
Posts: 3,134
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by booble View Post
aahh ok, Its perfect then. This is my doubt. Further I will install the mod...

On the future,within a time If I unninstall this mod and I want index, there is any problem?
If you install the mod you will likely be blacklisted by the legitimate search engines. Install it ONLY if this is what you want.
Reply With Quote
Благодарность от:
booble
  #17  
Old 03-31-2014, 12:47 AM
booble booble is offline
 
Join Date: Apr 2012
Posts: 90
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by Max Taxable View Post
With Bop5's mod here, you can also hide individual threads from the unregistered/not logged in usergroup and this includes all spiders. This hides threads you designate regardless of what forum they are in, or of existing permissions.
very interesting...

--------------- Added [DATE]1396230562[/DATE] at [TIME]1396230562[/TIME] ---------------

Quote:
Originally Posted by Max Taxable View Post
If you install the mod you will likely be blacklisted by the legitimate search engines. Install it ONLY if this is what you want.
ok, thank you ozzy and Maxx. GOOD HELP!
Reply With Quote
  #18  
Old 03-31-2014, 12:52 AM
ozzy47's Avatar
ozzy47 ozzy47 is offline
 
Join Date: Jul 2009
Location: USA
Posts: 10,929
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Not a problem, glad to help.
Reply With Quote
  #19  
Old 03-31-2014, 01:00 AM
Max Taxable's Avatar
Max Taxable Max Taxable is offline
 
Join Date: Feb 2011
Posts: 3,134
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by Max Taxable View Post
If you install the mod you will likely be blacklisted by the legitimate search engines. Install it ONLY if this is what you want.
I should rephrase this. The mod alone won't get you blacklisted and in fact it is one of the better anti-spam tools around. It's the LIST you use with it - the one I linked to is for legitimate spiders for identification in "Who's Online" only. Using that LIST with this mod might lead to search engine blacklists. Follow the link in my signature for the right definitions list, to use with the "Ban Spiders" Mod.
Reply With Quote
  #20  
Old 03-31-2014, 01:01 AM
ozzy47's Avatar
ozzy47 ozzy47 is offline
 
Join Date: Jul 2009
Location: USA
Posts: 10,929
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Also, if you want to know if something will be indexed by a robot, view your site as a guest, and what ever you see while not logged in, is what the robots will see.
Reply With Quote
Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 05:32 PM.


Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.07744 seconds
  • Memory Usage 2,271KB
  • Queries Executed 13 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)ad_showthread_beforeqr
  • (1)ad_showthread_firstpost
  • (1)ad_showthread_firstpost_sig
  • (1)ad_showthread_firstpost_start
  • (1)bbcode_code
  • (7)bbcode_quote
  • (1)footer
  • (1)forumjump
  • (1)forumrules
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (1)navbar
  • (3)navbar_link
  • (120)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (2)pagenav_pagelink
  • (10)post_thanks_box
  • (3)post_thanks_box_bit
  • (10)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (2)post_thanks_postbit
  • (10)post_thanks_postbit_info
  • (10)postbit
  • (10)postbit_onlinestatus
  • (10)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open
  • (1)tagbit_wrapper 

Phrase Groups Available:
  • global
  • inlinemod
  • postbit
  • posting
  • reputationlevel
  • showthread
Included Files:
  • ./showthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_postinfo_query
  • fetch_postinfo
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showthread_start
  • showthread_getinfo
  • forumjump
  • showthread_post_start
  • showthread_query_postids
  • showthread_query
  • bbcode_fetch_tags
  • bbcode_create
  • showthread_postbit_create
  • postbit_factory
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • fetch_musername
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • post_thanks_function_fetch_thanks_bit_start
  • post_thanks_function_show_thanks_date_start
  • post_thanks_function_show_thanks_date_end
  • post_thanks_function_fetch_thanks_bit_end
  • post_thanks_function_fetch_post_thanks_template_start
  • post_thanks_function_fetch_post_thanks_template_end
  • pagenav_page
  • pagenav_complete
  • tag_fetchbit_complete
  • forumrules
  • navbits
  • navbits_complete
  • showthread_complete