KX - Spider Permissions

[Ziki]

This modification was brought to you by
KXDesign
http://www.kxdesign.com/


~Modification name
Spider Permissions

~Modification description
This modification allows you to set view permissions for the spiders/bots on your website or you can place them in your desired usergroup.

~Modification options

Enable?
Place into usergroup?
Usergroup ID
Can view forums?
Can view threads?
Can view who's online?
Can view profiles?
Can view albums?


~Modification info
File uploads: 0
File edits: 0
Templates: 0
Template edits: 0
Plugins: 1
SQL Queries: 0
Phrases: 17
Settings: 8
Hooks: 0

Install time: 3 sec
Install level: Easy

~Modification installation

Step 1: Import Product


~Modification changelog


1.0.0 - First Release



~Modification copyright
This may not be distributed,released or claimed as your work without author's permission.

[Ziki]

~Reserved~

[Bombowiec89]

spider can give a group ADMIN? will be indexing the forums and threads for the guest does not have access?

[Ziki]

You can give your spiders admin access though I strongly advice you don't.Yes spiders will be able to see these but guests won't.

[darkdiver]

great Idea, but how do you recognise the spider?

Eric

[Ziki]

It uses the default vBulletin spider recognize feature (thus reads the spiders from your spiders_vbulletin.xml)

[mark370]

Mark presses Installed :) but has a question: when we give these bots a Username HTML Markup it never shows in online.php is there any reason for this ?
And is there anyway round it.

[Ziki]

No,because we cannot literally place a bot into a usergroup,but this only assigns them permissions of that usergroup.Thus when viewing the members of that usergroup,it is empty :)

[mark370]

Cheers for your prompt reply Ziki (https://vborg.vbsupport.ru/member.php?u=117597) :)

[digicom]

Installed Thanks

[Rene Kriest]

This seems to be the next big thing to me. :)

However I've got one question: will restrictions based on the Cyb - Advanced Permissions Based on Post Count-add-on interfere with your add-on?

Thank you in advance.

[7lanet]

google web masters considered it a violation of laws
The google disable archive site which uses this method
Is this true ?

[Hornstar]

Thanks for sharing, however, this is black seo, as your search engines are seeing content that guest can not. This will seriously get you de-ranked in search engines when google works out that your doing this. I strongly suggest not doing this method.

[Ziki]

This seems to be the next big thing to me. :)

However I've got one question: will restrictions based on the Cyb - Advanced Permissions Based on Post Count-add-on interfere with your add-on?

Thank you in advance.

I guess this will override them.

google web masters considered it a violation of laws
The google disable archive site which uses this method
Is this true ?

Partly I guess.It shows the content that registered users can see (which are humans) but guests might not (depends on your options).So it's not a complete violation.But yes,it can happen.

Thanks for sharing, however, this is black seo, as your search engines are seeing content that guest can not. This will seriously get you de-ranked in search engines when google works out that your doing this. I strongly suggest not doing this method.

Please view above.

[Orakk]

Black seo & google doesn't like this mod I read. Oh Didms..

My thanks to members for posting said infomation but I do take issue with .corps whom ignore robots.txt and try waving the big stick when we ark up, using a tool that works.


Thanks Ziki, your a champion. :up:

This plugin has saved us much time.. :D

[CableSux]

I installed it but I really just wanted google adsense to have access to multiple private group forums for the purpose of targeted advertising. Does this mod allow multiple groups?

[Ziki]

Only one

[nooofe]

Thanks

[Sweeks]

So I can do this?

Place bots in xx usergroup and then use template conditionals to hide the content from the bots?
________
Hot Box Vaporizers (http://hotboxvaporizers.com)

[Ziki]

Yes!

[Sweeks]

Perfect, great for some of our on top content which I dont want indexing :D Thank you! Installed.

One question, is there a way of finding out if the non displayed content is being picked up by the spiders or not?

This is very impressive and I have found it very useful.
________
YAMAHA RAPTOR 700R HISTORY (http://www.yamaha-tech.com/wiki/Yamaha_Raptor_700R)

[Hitterman]

I was looking for this mod from last 5 months. There were some but they were very not compatible. Thanks!

INSTALLED

[Sweeks]

It seems google can still crawl the content I wanted to hide
________
Chevrolet K5 Blazer Specifications (http://www.chevy-wiki.com/wiki/Chevrolet_K5_Blazer)

[Ziki]

No,it's just the google cache,or it just accessed the NO permission page.

[Sweeks]

Will using this mod for hiding content to bots get you penalised? Basically what I am wanting to hide is text at the top of our forum:

Total Discussions: 3,474 | Total Messages: 71,832 |
Online Now!
Online: 51 | Newbie: Don't Forget Me
________
Motorcycle Tires (http://www.motorcycle-tech.com/tires/motorcycle-tires)

[Ziki]

Yes hiding content can get you penalized.

[Sweeks]

I will be removing this then. It is a shame because this content is right at the top and not really content, more statistics which shouldn't really be indexed.
________
COLORADO MEDICAL MARIJUANA (http://colorado.dispensaries.org/)

[Ziki]

Well that should be OK I believe.

[Sweeks]

I might try asking over at vBseo about this, they might know for sure :D
________
RHODE ISLAND MEDICAL MARIJUANA (http://rhodeisland.dispensaries.org/)

[SSJB_7]

thanks i think it's very usefull

[Pure Dope]

this is not hiding content. the content is there if the people just join. hell...

whats the difference between doing this and making it so they cant view attachments?

google pulled some foul scheme on me.......they tricked me into registering for GOOGLE SEARCH ENGINE, ADSENSE, ADWORDS, and a bunch of other ish. lmoba.

google aint shit.

[bhanuprasad1981]

i am using this to hide advertisements from spiders ,i have adbrite full page ads enabled on my site due to which spider activity got down , i cant switch off ads since they are income source , so i gave spiders a new group with same view permissions of guest but disabled ads to that group using an ad management system , so this means google sees all same as guest but no ads :D thanks to developer .

[CableSux]

What am I doing wrong? I have multiple group membership forums, I.E. Politics, Religion, etc. I created a group (92) just for Adsense and called it Adsense. I gave this group permission to view all forums (under forum permissions). I set up KX - Spider Permissions Options to be a member of group 92. I set the remaining options to No (I've tried Yes as well). And Adsense Spider still gets "No Permission" errors (the red stop sign) when I look at Who's Online. And of course, I'm not getting adsense advertisements specific to the forums. I even set up a test user and put it in the same group (92) and it sees everything just fine. I love this mod but would like to get better targeted advertising out of adsense. Suggestions?

www.SatelliteWorld.com/satchat/
.

[hscorp]

i am using this to hide advertisements from spiders ,i have adbrite full page ads enabled on my site due to which spider activity got down , i cant switch off ads since they are income source , so i gave spiders a new group with same view permissions of guest but disabled ads to that group using an ad management system , so this means google sees all same as guest but no ads :D thanks to developer .
Google doesn't see this ads cause google doesn't execute javascripts

http://www.webmasterworld.com/google/3378000.htm
http://www.webmasterworld.com/forum30/28915.htm
http://www.google.com/search?q=google+follow+javascript+links&ie=utf-8&oe=utf-8&aq=t&rls=org.mozilla:en-US:official&client=firefox-a

[Arrogant-One]

No,because we cannot literally place a bot into a usergroup,but this only assigns them permissions of that usergroup.Thus when viewing the members of that usergroup,it is empty :)

I have usergroup color bar installed on my forum - which is a fantastic mod!. Unfortunately placing the Spiders in a usergroup doesn't make them show up in the color legend, likely for the reason above. Would be great if these 2 mods could work together.

[CableSux]

What am I doing wrong? I have multiple group membership forums, I.E. Politics, Religion, etc. I created a group (92) just for Adsense and called it Adsense. I gave this group permission to view all forums (under forum permissions). I set up KX - Spider Permissions Options to be a member of group 92. I set the remaining options to No (I've tried Yes as well). And Adsense Spider still gets "No Permission" errors (the red stop sign) when I look at Who's Online. And of course, I'm not getting adsense advertisements specific to the forums. I even set up a test user and put it in the same group (92) and it sees everything just fine. I love this mod but would like to get better targeted advertising out of adsense. Suggestions?

www.SatelliteWorld.com/satchat/


I still have no resolution with this. I'm still getting generic satellite ads in my non-satellite forums (Politics, Religion, Sports, etc.). Even if I set the usergroup ID to 6 or 5 (super moderator/admin), no change, permissions error. It seems there's no connection between the usergroup ID and the forums the group has access to. I'm sure I'm missing something obvious, but it's not obvious to me right now. :D

.

[koolasia]

Is this really against google.. from what i know invision power board has this feature built in

[Makaveli007]

oh yes i been looking for a mod like this for so long. excellent

[CableSux]

Bump

My problem is still not resolved. See post #36

I also added Amazon.com adverts to my site and I see it works the same as Adsense...and getting the error messages. But it's showing up as Guest. Any way to add them to the list of search engines? I added them to the XML file, but it still shows up as Guest.

[Manoel J?nior]

Is to make the Google Translate have the same permissions as a member?

[Ba$im]

can I use vbulletin contition with spider?
I mean I have some text or links on footer
and I don’t google can see it
could this be with this plugin?

[ajmboy]

Has anyone seen their registration rates go up by blocking threads to guests? I'm curious. This seems like what IPB has. Is there a list to update spider ips for recognition?

[sat2006]

Whether to install this product site for security is a loss?

And suggest you install it doing?

Please explain comprehensive. And thank