vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vB3 Programming Discussions (https://vborg.vbsupport.ru/forumdisplay.php?f=15)
-   -   Age restriction access - over 18s only, but search engines allowed - how? (https://vborg.vbsupport.ru/showthread.php?t=206985)

Spinball 03-01-2009 09:44 AM

Age restriction access - over 18s only, but search engines allowed - how?
 
Folks, I want to add a script to my site which requests the visitor to confirm that they are over 18 before they can view pages, but search engine spiders are allowed access so that we get logged into the search engines.
Is there such a mod available? (Haven't found one).
How would I do this, please?

redhawk89 03-01-2009 10:13 AM

Quote:

Originally Posted by Spinball (Post 1757477)
Folks, I want to add a script to my site which requests the visitor to confirm that they are over 18 before they can view pages, but search engine spiders are allowed access so that we get logged into the search engines.
Is there such a mod available? (Haven't found one).
How would I do this, please?

Why don't you just change the registration message for users? It's in the vB language manager I think.

Spinball 03-01-2009 11:22 AM

That would apply to members, but I don't want guests reading the forums without first acknowledging that they are over 18.

Antivirus 03-01-2009 03:52 PM

You need to add nofollow tag to any links which reference the page you want to prevent spiders from accessing like so:

<a href="spidersforbidden.php" rel="nofollow">link</a>

This will prevent spiders from crawling the frbidden script.

Spinball 03-01-2009 04:03 PM

Quote:

Originally Posted by Antivirus (Post 1757635)
You need to add nofollow tag to any links which reference the page you want to prevent spiders from accessing like so:

<a href="spidersforbidden.php" rel="nofollow">link</a>

This will prevent spiders from crawling the frbidden script.

Thanks, but that's not going to work, either, since I want the 'over 18' check to work on every page (it will have to be using Javascript) and that includes directly typing in the URL.

Mr-Moo 03-01-2009 05:07 PM

I am somewhat unclear on the reasoning behind having this feature. If I am not mistaken when a search engine crawls your site it also creates a cache in which users can browse. This almost defeats the purpose of age-restriction.

An alternate method is to grab the VBSEO sitemap generator and use that to generate your sitemap and submit to Google/Yahoo/MSN, then continue with the 18 year old user-restriction on every page.

vbplusme 03-02-2009 09:40 AM

Quote:

Originally Posted by Antivirus (Post 1757635)
You need to add nofollow tag to any links which reference the page you want to prevent spiders from accessing like so:

<a href="spidersforbidden.php" rel="nofollow">link</a>

This will prevent spiders from crawling the frbidden script.


You are referring to "good" spiders? If the script needs to be off-limits to spiders, would that require a rule in .htaccess ? Just a thought.

Spinball 03-02-2009 10:03 AM

Quote:

Originally Posted by Mr-Moo (Post 1757697)
I am somewhat unclear on the reasoning behind having this feature. If I am not mistaken when a search engine crawls your site it also creates a cache in which users can browse. This almost defeats the purpose of age-restriction.

An alternate method is to grab the VBSEO sitemap generator and use that to generate your sitemap and submit to Google/Yahoo/MSN, then continue with the 18 year old user-restriction on every page.

Ok, it's an adult DVD trading website www.adultdvdforums.com. I don't want to restrict access to spiders cos we need the site to get into search engines. I don't care if people see the content of the site from Google or other search engine caches, but I would like all visitors to the site to go through an 'I am over 18' check before they proceed into any pages. Should have made this clear from the top, sorry.

Marco van Herwaarden 03-02-2009 10:25 AM

Presenting different content to a SE spider and to regular visitors is considered Cloacking and might get you removed from the SE.

Spinball 03-02-2009 11:22 AM

Quote:

Originally Posted by Marco van Herwaarden (Post 1758390)
Presenting different content to a SE spider and to regular visitors is considered Cloacking and might get you removed from the SE.

Thanks. That could present a bit of a problem. I'll ask Google, I think.


All times are GMT. The time now is 01:01 PM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01825 seconds
  • Memory Usage 1,738KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (5)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (1)pagenav_pagelink
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (10)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete