Go Back   vb.org Archive > vBulletin 3 Discussion > vB3 Programming Discussions
FAQ Community Calendar Today's Posts Search

Reply
 
Thread Tools Display Modes
  #1  
Old 03-01-2009, 09:44 AM
Spinball's Avatar
Spinball Spinball is offline
 
Join Date: Feb 2002
Location: Telford, England
Posts: 705
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default Age restriction access - over 18s only, but search engines allowed - how?

Folks, I want to add a script to my site which requests the visitor to confirm that they are over 18 before they can view pages, but search engine spiders are allowed access so that we get logged into the search engines.
Is there such a mod available? (Haven't found one).
How would I do this, please?
Reply With Quote
  #2  
Old 03-01-2009, 10:13 AM
redhawk89 redhawk89 is offline
 
Join Date: Dec 2008
Posts: 139
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by Spinball View Post
Folks, I want to add a script to my site which requests the visitor to confirm that they are over 18 before they can view pages, but search engine spiders are allowed access so that we get logged into the search engines.
Is there such a mod available? (Haven't found one).
How would I do this, please?
Why don't you just change the registration message for users? It's in the vB language manager I think.
Reply With Quote
  #3  
Old 03-01-2009, 11:22 AM
Spinball's Avatar
Spinball Spinball is offline
 
Join Date: Feb 2002
Location: Telford, England
Posts: 705
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

That would apply to members, but I don't want guests reading the forums without first acknowledging that they are over 18.
Reply With Quote
  #4  
Old 03-01-2009, 03:52 PM
Antivirus's Avatar
Antivirus Antivirus is offline
 
Join Date: Sep 2004
Location: Black Lagoon
Posts: 1,090
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

You need to add nofollow tag to any links which reference the page you want to prevent spiders from accessing like so:

<a href="spidersforbidden.php" rel="nofollow">link</a>

This will prevent spiders from crawling the frbidden script.
Reply With Quote
  #5  
Old 03-01-2009, 04:03 PM
Spinball's Avatar
Spinball Spinball is offline
 
Join Date: Feb 2002
Location: Telford, England
Posts: 705
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by Antivirus View Post
You need to add nofollow tag to any links which reference the page you want to prevent spiders from accessing like so:

<a href="spidersforbidden.php" rel="nofollow">link</a>

This will prevent spiders from crawling the frbidden script.
Thanks, but that's not going to work, either, since I want the 'over 18' check to work on every page (it will have to be using Javascript) and that includes directly typing in the URL.
Reply With Quote
  #6  
Old 03-01-2009, 05:07 PM
Mr-Moo Mr-Moo is offline
 
Join Date: Sep 2007
Location: Chicago, IL.
Posts: 130
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

I am somewhat unclear on the reasoning behind having this feature. If I am not mistaken when a search engine crawls your site it also creates a cache in which users can browse. This almost defeats the purpose of age-restriction.

An alternate method is to grab the VBSEO sitemap generator and use that to generate your sitemap and submit to Google/Yahoo/MSN, then continue with the 18 year old user-restriction on every page.
Reply With Quote
  #7  
Old 03-02-2009, 09:40 AM
vbplusme vbplusme is offline
 
Join Date: Sep 2008
Location: CyberSpace
Posts: 332
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by Antivirus View Post
You need to add nofollow tag to any links which reference the page you want to prevent spiders from accessing like so:

<a href="spidersforbidden.php" rel="nofollow">link</a>

This will prevent spiders from crawling the frbidden script.

You are referring to "good" spiders? If the script needs to be off-limits to spiders, would that require a rule in .htaccess ? Just a thought.
Reply With Quote
  #8  
Old 03-02-2009, 10:03 AM
Spinball's Avatar
Spinball Spinball is offline
 
Join Date: Feb 2002
Location: Telford, England
Posts: 705
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by Mr-Moo View Post
I am somewhat unclear on the reasoning behind having this feature. If I am not mistaken when a search engine crawls your site it also creates a cache in which users can browse. This almost defeats the purpose of age-restriction.

An alternate method is to grab the VBSEO sitemap generator and use that to generate your sitemap and submit to Google/Yahoo/MSN, then continue with the 18 year old user-restriction on every page.
Ok, it's an adult DVD trading website www.adultdvdforums.com. I don't want to restrict access to spiders cos we need the site to get into search engines. I don't care if people see the content of the site from Google or other search engine caches, but I would like all visitors to the site to go through an 'I am over 18' check before they proceed into any pages. Should have made this clear from the top, sorry.
Reply With Quote
  #9  
Old 03-02-2009, 10:25 AM
Marco van Herwaarden Marco van Herwaarden is offline
 
Join Date: Jul 2004
Posts: 25,415
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Presenting different content to a SE spider and to regular visitors is considered Cloacking and might get you removed from the SE.
Reply With Quote
  #10  
Old 03-02-2009, 11:22 AM
Spinball's Avatar
Spinball Spinball is offline
 
Join Date: Feb 2002
Location: Telford, England
Posts: 705
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by Marco van Herwaarden View Post
Presenting different content to a SE spider and to regular visitors is considered Cloacking and might get you removed from the SE.
Thanks. That could present a bit of a problem. I'll ask Google, I think.
Reply With Quote
Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 04:57 PM.


Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.04760 seconds
  • Memory Usage 2,257KB
  • Queries Executed 13 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)ad_showthread_beforeqr
  • (1)ad_showthread_firstpost
  • (1)ad_showthread_firstpost_sig
  • (1)ad_showthread_firstpost_start
  • (5)bbcode_quote
  • (1)footer
  • (1)forumjump
  • (1)forumrules
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (1)navbar
  • (3)navbar_link
  • (120)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (1)pagenav_pagelink
  • (10)post_thanks_box
  • (10)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (10)post_thanks_postbit_info
  • (10)postbit
  • (10)postbit_onlinestatus
  • (10)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open
  • (1)tagbit_wrapper 

Phrase Groups Available:
  • global
  • inlinemod
  • postbit
  • posting
  • reputationlevel
  • showthread
Included Files:
  • ./showthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_postinfo_query
  • fetch_postinfo
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showthread_start
  • showthread_getinfo
  • forumjump
  • showthread_post_start
  • showthread_query_postids
  • showthread_query
  • bbcode_fetch_tags
  • bbcode_create
  • showthread_postbit_create
  • postbit_factory
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • fetch_musername
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • pagenav_page
  • pagenav_complete
  • tag_fetchbit_complete
  • forumrules
  • navbits
  • navbits_complete
  • showthread_complete