KX - Spider Permissions
 

~Reserved~

Is it work with Version 3.7

https://vborg.vbsupport.ru/showthread.php?t=196418

That is the 3.7 version but you can install this one as well,because they are almost identical

thanks

this modification great
^_^

google web masters considered it a violation of laws
The google disable archive site which uses this method
Is this true ؟

Sites using this will get removed from google.

Are u sure ?

That is BS, I have a similar mod on one of my forums where the spiders act as a member and they are allowed to few all my rooms. https://vborg.vbsupport.ru/showthread.php?t=108070

I have not been band and my traffic has increase by 5x. I will be installing this mod on my 3.8 if it works as good as the other one, and if the old one that I have can not work on 3.8

How does it compeer to the link above and does it do the same thing but just for 3.8?

thanks

Who ever installs this board is putting their ite in great danger. If someone reports their site to google their site will be removed from SE index forever.

Joh , if you want to proove it is bullshit or not , you can share your link with me and i'll be gladly report your site to google.

Lizard King, it is people like you that may cause a broad to get ban, stop hating on the guy mod and make one that is better.

This is not the format for you, it is to talk about if the mod works as he said it would.
A lot of people may speak out against a lot of the mods on this site, but yet they use them, At one point it was said that using vbseo was going to get you band because it ping Google, place links from all your forums in your footer on your front page so that the bots can index them all, which means that you could get band from Google too.

some of you made a stink about the mod that let you read all pms on your site.
the list can go on and on and on. Stop the hate, stop telling people that things will happen simply because they install a mod.

My question above still stand.
Lizard King the most people like you can hope for is that people do not click install and that the coder stop coding.

Well,this actually works :),it allows you to have specific permissions and place them into a usergroup you want :)

Partly I guess.It shows the content that registered users can see (which are humans) but guests might not (depends on your options).So it's not a complete violation.But yes,it can happen.

(View above)

I am not sure if this works. All my spiders still get the "Viewing 'No Permission' Message & Viewing Error Message". I have installed, set permissions, and it is active. Did I miss something. Are there other edits, or permissions that must be made. Is there a special spiders mod that must be installed. Let me know. Thanks for your time.

No this should be all.Can someone also report this as not working?

it can be done via robotx.txt .........

No it can't :)

It can be done via robot.txt Ziki.

vBSEO is using all white hat seo tactics and there is no feature that will get you banned on google. I donot have hate at all. I just warn people with the truth.

If they use this mod and they choose this mod to display bots different content than guest. It will get their site dropped out of SE 's index.

You can block them from accessing files and folders but not forum features.

Like I said people can access the content that the SE can as well (like threads and forums).

So is there an answer to my question. The problem I am having.

I am trying to understand what this does and how adding:

in a robots.txt file is any different outside of assigning a specific user group within VB to do the same?

Try allowing them to access usercp :)

Then just use:

Your reply was less then helpful. I still do not understand.

In fact a robotos.txt file for VB should encompass:

No being a hater, I just do not understand what differences your plugin accomplishes that a robots.txt file can't do.

I said allow bots to access usercp not to disallow ;)

Devils advocate...

I thought unless you dis-allow that robots will auto spider your site. Also why allow usercp.php? I would think this would be duplicate information. Duplicate information is not seo friendly plus a bandwidth waster?

Well I don't care what people do with this modification,I released this because of a request.

Don't bash people who are trying to help us understand the ramifications of using a particular modification. I certainly don't want to break the Google rules and if there is a chance that could happen and the mod author forgot to tell us about that issue, then I appreciate someone like Lizard King letting me know. It sounds like if you knew a law or rule was being broken that might harm someone's website, you wouldn't say a word. Someone like that would be far more problematic than Lizard King.

Not always. I am checking this mod out for a specific purpose that can't be handled by robots.txt.

Keep doing what you're doing, Lizard King. I appreciate your efforts. However, this mod may just be the thing some of us might need to allow the Adsense spiders to crawl private forums that also have ads.

I do appreciate your hard work on this, but I always appreciate these kinds of efforts more when the author of a mod also cares about how the modification is used. If it might cause a problem with a search engine's rules about accessing content that an unregistered visitor couldn't also access, you might put a disclaimer in the modification's description. Give the user the information they require to make a wise decision.

What I am interested in doing, and I think there might be a wide use for this, is to allow the Mediapartners-Google* spiders to crawl private forums that also contain Adsense ads. I run a forum for flooring professionals and consumers. There are a number of forums on my site that only pros can view and participate in. Consumers and, of course, unregistered or unlogged in members can't view the content there. I need a way to allow the Adsense only spiders to access the private forums to help them place content relevant advertisements.

This is NOT against the Google rules. There is a place you can set up authentication for the Adsense spiders (https://www.google.com/adsense/edit-auth), but it doesn't appear to work with vBulletin private forums. If this modification works for that particular bot, then you truly do have a very valuable tool to offer vBulletin webmasters.

My hope is that the modification has the ability to select which bots you want to give access - and that the Mediapartners-Google* bot is one of them. Maybe you could edit your description to let us know this and post some screen shots of the options panel. As it is, I have to download and install to know the answers to these questions.

Anyway, thanks for offering a solution - if it is a solution to what I need.

Best R'gards,

Jim McClain

Well, apparently this mod does not give you very many choices. There are no choices as to which spiders can have access and which ones cannot. Although spiders can be added to specific usergroups, there doesn't seem to be a way a spider could log in or utilize a password. If there is some way that any ol' spider can have access to private areas of my forum, then what is there to prevent a malicious user from impersonating a search spider to gain access to secure areas of my forum?

Sorry, this doesn't seem to be a secure modification with enough options to make it useful to me.

Jim

This modification places the spiders defined in your spiders.xml into the usergroup specified.So you cannot fool it ;)

wow this looks sweet, its like what IP.Boards have right? put the spiders in there own group.
and alow only the spider that are in spider display in admin panel. as for vbulletin, the spiders allowed would be vbulletin spider list.xml right? i think thats what your saying above ;)
this would be good to get members to sign up to view the thread they found on google that the bots can only see. nice job ;)

It is a violation of Google's rules. They may consider this "cloaking." One of the definitions of cloaking is:
It's likely that putting a spider in a special position to see content that is not available to unregistered users would be considered cloaking ind it will get your website removed from the Google indexed pages.

Jim

Well but users can see the content that the spiders can as well.Let's say you disabled guest viewing of your threads,but registered still can see.So spiders can actually see,what users can as well.

That's not the same. If you have to devise special code, whether that be template edits or a plug-in, you are giving the spiders an advantage website visitors do not have. If the content is blocked from view until a user meets certain requirements, like registering, agreeing to terms and being added to a special usergroup, then you are causing the spiders to circumvent these requirements, which the normal user cannot do.

If the possibility exists for a user of this modification to be banned or penalized by Google or another popular search engine, you should state it in the modification description. If you have proof that search engines will not punish users of this mod, then there isn't a problem. It's my opinion that you have an ethical responsibility to your customers (a customer isn't always someone who pays a fee) to keep them informed of any possible consequences from using this software.

Jim

Ok Sir.

well if IP.Boards are allowed to do it the last few years, then so can we yeah? it comes standard with IP.Boards, its bloody built in m8...get banned from google. you mean black listed? i'd doubt that to. its all about the guests, what users can see bots can see, also i see no IP.Boards black listed. copy and paste where its says on google about "guests" or send me a link. ""Guests"". no offense but send some proof on this page, as what you told Ziki to add is going to scare everyone off from using this addon completely.
yeah agreed, be safe, but bring on the proof first.
also hows the bots going to no what guests can see or cant see?
sorry but this is just the same as what comes standard with IP.Boards, if they can use it so can we true? other wise this to me makes no damn sense.

Congratulations. You have caused Ziki to edit the description back to the way it was, without the disclaimer. I don't use IPBoards, so I wouldn't know if what you say is true or not. I do use Google and the quote I provided above comes from here: http://www.google.com/support/webmas...n&answer=66355 No, it doesn't use the exact term "Guests", but then it doesn't use many other terms that might imply the same thing. It uses "users." Why don't you provide the same sort of "proof?"

Exactly. Where's your proof? Look, this debate could go on and on. If you want to have a debate about what Google and other search engines like and don't like, start a new topic. I merely agreed with at least one other very experienced webmaster that the possibility exists that this mod is in violation of Google terms. The debate rages on and unless we get a definitive answer from Google itself, regarding the practice of allowing it to index content that its users will click the link to and get an error message instead of the content, then neither you nor I will have the "proof."

As I said before, that you apparently didn't read even though you quoted it, it's my opinion that Ziki has an ethical responsibility to his customers to warn them of the possibilities. I've got nothing to gain or lose by keeping people from using this mod. It's only my desire to help my fellow webmasters who may be looking for legitimate ways to bring relevant content, including advertising, to my users. This product does not appear to be that and it may be detrimental to my ranking and indexing in Google and other search engines.

I'm taking a wild guess here that, based on the content of your avatar and signature, you're prob'ly around a teenager. I don't know how much experience you have as a webmaster, but mine goes back to about the time you were born (in other words, in the teens). I'm old and I hope I am wise in some matters. My personal rulZZZ: don't argue with children. I'm done with this conversation.

I guess it's time I enter into this conversation.My ethical responsibility to warn the users would be if I was sure this modification would negatively affect their website.I am sure that this does not conflict with Google TOS,as spiders can see the same content as the board's users can.

As another point that's off this topic,is that you shouldn't judge someone according to their age.For first it's discrimination and as a second point,you would be surprised how many adults behave childish.

You have the right to choose your own ethical standards. I believe you are wrong about the board's users being able to see the content Google spiders index. If Google indexes a private forum and it appears as a search result for a given term, when the searcher clicks the link, they will receive a "No Permissions" message. You have given Google a view of content that no one else can see unless they meet certain requirements. That could be defined as cloaking, but it is almost certainly subterfuge.

I am prejudiced against children. I don't like them. So sue me.

Jim

Guests get that message even if you disabled forum view and has your forum in index.
I think there is a big difference between children,teenagers and adults,although there is a thin line between children and adults.I would like to end this discussion as it's becoming hatred.