Board Optimization - KX - Spider Permissions

This modification was brought to you by
KXDesign

http://www.kxdesign.com/

~Modification name
Spider Permissions

~Modification description
This modification allows you to set view permissions for the spiders/bots on your website or you can place them in your desired usergroup.


~Modification options

• Enable?
• Place into usergroup?
• Usergroup ID
• Can view forums?
• Can view threads?
• Can view who's online?
• Can view profiles?
• Can view albums?

~Modification info
File uploads: 0
File edits: 0
Templates: 0
Template edits: 0
Plugins: 1
SQL Queries: 0
Phrases: 17
Settings: 8
Hooks: 0

Install time: 3 sec
Install level: Easy

~Modification installation

Step 1: Import Product


~Modification changelog

• 1.0.0 - First Release

~Modification copyright
This may not be distributed,released or claimed as your work without author's permission.

[unp]

webmasterworld.com used this technique for years, results and description would appear in google but clicking the links would take you to a login page,
They were never penalized,

[ShawneyJ]

Originally Posted by eJM

Why don't you provide the same sort of "proof?"

IP.Boards AdminCP
Treat spider/bot as part of which group?
This is useful as you can specify group settings for a 'bot' group which can restrict access to certain areas, etc. just like Ziki's addon. Please note: you can make a bot group and give bots there own permissions.


Force spider/bot to use skin
This is useful as you can create a 'lite' optimized skin for your spiders to use to reduce bandwidth and increase the depth of the bot crawling.


Spider Bot User-Agent
Use this section to list which search engine user-agents you'd like to be treated as a search engine visit along with a 'human' name for the online list in a bot=Human Name format.(one per line)
Example: googlebot=Google.com

Originally Posted by eJM

based on the content of your avatar and signature, you're prob'ly around a teenager. I don't know how much experience you have as a webmaster, but mine goes back to about the time you were born (in other words, in the teens). I'm old and I hope I am wise in some matters. My personal rulZZZ: don't argue with children. I'm done with this conversation.

well you didnt learn much in that time lol.
did you no that Avril is an Adult which mite make you think im one to lol.
actually im not going to flam anyone like you are, if im wrong i dont cry like
a little girl. no offense but your just plain wrong.
you started something you couldnt finish.


also, sorry Ziki, your thread has been attacked, its a sweet hack and keep up the good work m8.
this will be my last post unless i need support for your addon.
but at least now everyone can see that IP.Boards/invision comes with
this built in and can see how useful your addon/hack is
cheers.

[eJM]

Originally Posted by jaycob

IP.Boards AdminCP
Treat spider/bot as part of which group?
This is useful as you can specify group settings for a 'bot' group which can restrict access to certain areas, etc. just like Ziki's addon. Please note: you can make a bot group and give bots there own permissions.

Notice that is says "restrict access" not gain access.

Force spider/bot to use skin
Spider Bot User-Agent

Neither of these are a violation of any rule.

well you didnt... ssssniiiip

As you kids like to say, whateverrrrr.

also, sorry Ziki, your thread has been attacked...

BS! An issue has been brought to light. You can delude yourself all you want, but it is still an issue. Your proof is not. Ask IPBoard support whether that feature is designed to give access to Google when it blocks others. It doesn't. You can use it to gain access to restricted areas if you want, but it was NOT designed to violate any Google or other search engine terms of service. I am familiar with the product. I've been managing message boards of all types since 1992.

If you want to continue this discussion further, then honor the mod author by complying with his request. Start a new thread somewhere else about it.

Jim

[Ziki]

Ok that does it.I had to report both of you.If you can't discuss in a mature way about the topic (Is this modification SE friendly?) and just insult yourself,please do it in a private discussion.This is not a place for such conversation.

[Marco van Herwaarden]

I am sure that this does not conflict with Google TOS,as spiders can see the same content as the board's users can.

Sorry to burst the bubble, but those warnings are correct.

Serving different content (layout is not an issue) to spiders and to visitors (and not registered members) is considered cloaking and can get you blacklisted on SE's.

[Leo Brazil]

Originally Posted by eJM

It is a violation of Google's rules. They may consider this "cloaking." One of the definitions of cloaking is:

It's likely that putting a spider in a special position to see content that is not available to unregistered users would be considered cloaking ind it will get your website removed from the Google indexed pages.

In fact this is kind of violation of Google's rules. But it takes time to Google punish you but trust me they'll.
And don't forget you're playing like "My Game, my rules", I mean Google can simply ban you from their lists and you'll have to do whatever they want. The problem is it takes a lot of time to get back to their lists if you were banned.

I can tell you that because I've seen this before, a friend of mine had an issue with Google about cloaking. His board was on the web about two years with a kind of cloaking, he always tried to convince us that wasn't against rules and something. One day he was notified by Google and he took almost one year to get back to their lists.
The problem is if you are listed due cloaking there's no argue with them at all, you're guilt and that's it and have to do whatever they want.

I'm not telling this because I think this is a BS, waste of time and nothing like this. In fact I think it's got potential. This this is for who really wants what they want and the risks for.

[Orakk]

Originally Posted by Zia

it can be done via robotx.txt .........

That text file is just a polite request which many, if not most bots ignore. One only need check their log files to see this is true and is common knowledge via google search the thing is close on useless.

Fair enough, if you don't want to risk up setting google then so be it but there are many of us who see being indexed as a waste of time and invasion of our privacy.

Thanks again for this plugin, home is much calmer now.. :up:

[hscorp]

ziki i really appreciate this mod and i hope it work

but it doesn't look to work with me

see the wol pic and setting pic

[Ziki]

Try placing them into a usergroup.

[CableSux]

Originally Posted by dirtyfeast

I am not sure if this works. All my spiders still get the "Viewing 'No Permission' Message & Viewing Error Message". I have installed, set permissions, and it is active. Did I miss something. Are there other edits, or permissions that must be made. Is there a special spiders mod that must be installed. Let me know. Thanks for your time.

Originally Posted by Ziki

No this should be all.Can someone also report this as not working?

Originally Posted by Ziki

Try placing them into a usergroup.

I'm having the same problem with the 3.7 version.
https://vborg.vbsupport.ru/showpost....4&postcount=33
I'm getting ready to upgrade to 3.8. Has anything changed in 3.8 to make it work?
.