vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vBulletin 3.8 Add-ons (https://vborg.vbsupport.ru/forumdisplay.php?f=235)
-   -   Board Optimization - KX - Spider Permissions (https://vborg.vbsupport.ru/showthread.php?t=196420)

unp 12-09-2008 04:28 AM

webmasterworld.com used this technique for years, results and description would appear in google but clicking the links would take you to a login page,
They were never penalized,

ShawneyJ 12-09-2008 06:28 AM

Quote:

Originally Posted by eJM (Post 1681035)
Why don't you provide the same sort of "proof?"

IP.Boards AdminCP
Treat spider/bot as part of which group?
This is useful as you can specify group settings for a 'bot' group which can restrict access to certain areas, etc. just like Ziki's addon. Please note: you can make a bot group and give bots there own permissions.
https://vborg.vbsupport.ru/external/2008/12/83.jpg

Force spider/bot to use skin
This is useful as you can create a 'lite' optimized skin for your spiders to use to reduce bandwidth and increase the depth of the bot crawling.
https://vborg.vbsupport.ru/external/2008/12/84.jpg

Spider Bot User-Agent
Use this section to list which search engine user-agents you'd like to be treated as a search engine visit along with a 'human' name for the online list in a bot=Human Name format.(one per line)
Example: googlebot=Google.com
https://vborg.vbsupport.ru/external/2008/12/85.jpg

Quote:

Originally Posted by eJM (Post 1681035)
based on the content of your avatar and signature, you're prob'ly around a teenager. I don't know how much experience you have as a webmaster, but mine goes back to about the time you were born (in other words, in the teens). I'm old and I hope I am wise in some matters. My personal rulZZZ: don't argue with children. I'm done with this conversation.

well you didnt learn much in that time lol.
did you no that Avril is an Adult which mite make you think im one to lol.
actually im not going to flam anyone like you are, if im wrong i dont cry like
a little girl. no offense but your just plain wrong.
you started something you couldnt finish.


also, sorry Ziki, your thread has been attacked, its a sweet hack and keep up the good work m8.
this will be my last post unless i need support for your addon.
but at least now everyone can see that IP.Boards/invision comes with
this built in and can see how useful your addon/hack is ;)
cheers.

eJM 12-09-2008 07:46 AM

Quote:

Originally Posted by jaycob (Post 1681449)
IP.Boards AdminCP
Treat spider/bot as part of which group?
This is useful as you can specify group settings for a 'bot' group which can restrict access to certain areas, etc. just like Ziki's addon. Please note: you can make a bot group and give bots there own permissions.

Notice that is says "restrict access" not gain access.
Quote:

Force spider/bot to use skin
Spider Bot User-Agent
Neither of these are a violation of any rule.

Quote:

well you didnt... ssssniiiip
As you kids like to say, whateverrrrr.

Quote:

also, sorry Ziki, your thread has been attacked...
BS! An issue has been brought to light. You can delude yourself all you want, but it is still an issue. Your proof is not. Ask IPBoard support whether that feature is designed to give access to Google when it blocks others. It doesn't. You can use it to gain access to restricted areas if you want, but it was NOT designed to violate any Google or other search engine terms of service. I am familiar with the product. I've been managing message boards of all types since 1992.

If you want to continue this discussion further, then honor the mod author by complying with his request. Start a new thread somewhere else about it.

Jim

Ziki 12-09-2008 11:57 AM

Ok that does it.I had to report both of you.If you can't discuss in a mature way about the topic (Is this modification SE friendly?) and just insult yourself,please do it in a private discussion.This is not a place for such conversation.

Marco van Herwaarden 12-09-2008 02:07 PM

Quote:

I am sure that this does not conflict with Google TOS,as spiders can see the same content as the board's users can.
Sorry to burst the bubble, but those warnings are correct.

Serving different content (layout is not an issue) to spiders and to visitors (and not registered members) is considered cloaking and can get you blacklisted on SE's.

Leo Brazil 12-09-2008 03:00 PM

Quote:

Originally Posted by eJM (Post 1680384)
It is a violation of Google's rules. They may consider this "cloaking." One of the definitions of cloaking is:

It's likely that putting a spider in a special position to see content that is not available to unregistered users would be considered cloaking ind it will get your website removed from the Google indexed pages.

In fact this is kind of violation of Google's rules. But it takes time to Google punish you but trust me they'll.
And don't forget you're playing like "My Game, my rules", I mean Google can simply ban you from their lists and you'll have to do whatever they want. The problem is it takes a lot of time to get back to their lists if you were banned.

I can tell you that because I've seen this before, a friend of mine had an issue with Google about cloaking. His board was on the web about two years with a kind of cloaking, he always tried to convince us that wasn't against rules and something. One day he was notified by Google and he took almost one year to get back to their lists.
The problem is if you are listed due cloaking there's no argue with them at all, you're guilt and that's it and have to do whatever they want.

I'm not telling this because I think this is a BS, waste of time and nothing like this. In fact I think it's got potential. This this is for who really wants what they want and the risks for.

Orakk 12-19-2008 06:08 AM

Quote:

Originally Posted by Zia (Post 1667360)
it can be done via robotx.txt .........

That text file is just a polite request which many, if not most bots ignore. One only need check their log files to see this is true and is common knowledge via google search the thing is close on useless.

Fair enough, if you don't want to risk up setting google then so be it but there are many of us who see being indexed as a waste of time and invasion of our privacy.

Thanks again for this plugin, home is much calmer now.. :up:

hscorp 01-28-2009 12:27 AM

ziki i really appreciate this mod and i hope it work

but it doesn't look to work with me

see the wol pic and setting pic

https://vborg.vbsupport.ru/

https://vborg.vbsupport.ru/

Ziki 01-28-2009 06:54 AM

Try placing them into a usergroup.

CableSux 03-17-2009 06:01 PM

Quote:

Originally Posted by dirtyfeast (Post 1667156)
I am not sure if this works. All my spiders still get the "Viewing 'No Permission' Message & Viewing Error Message". I have installed, set permissions, and it is active. Did I miss something. Are there other edits, or permissions that must be made. Is there a special spiders mod that must be installed. Let me know. Thanks for your time.

Quote:

Originally Posted by Ziki (Post 1667291)
No this should be all.Can someone also report this as not working?

Quote:

Originally Posted by Ziki (Post 1726946)
Try placing them into a usergroup.

I'm having the same problem with the 3.7 version.
https://vborg.vbsupport.ru/showpost....4&postcount=33
I'm getting ready to upgrade to 3.8. Has anything changed in 3.8 to make it work?
.


All times are GMT. The time now is 11:05 AM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01147 seconds
  • Memory Usage 1,756KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (12)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (4)pagenav_pagelink
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (10)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete