Member Bots 1.0 - Allow bots to act as members

--------- Member Bots 1.0 ---------
Written by Trilljester - http://www.trilliummud.com

This small mod allows you to treat search engine robots (i.e. GoogleBot, Yahoo Slurp) as registered users instead of guests, as they are treated by default in VBulletin.

This is handy if your site allows limited access to guests, but full access to registered users. By default, a search engine robot would only be allowed to index what a guest could see, but with this mod, it would allow them to fully index your site as a registered user.

This mod uses the spiders_vbulletin.xml file for determining if a visitor is a bot or not, so make sure you have that file up to date. The one that comes with VB is pretty sparse, but it works. If you're only interested in GoogleBot, then the default file works great.

WARNING! This mod requires a very small edit to a VBulletin core file. This means whenever you upgrade to a new version of VBulletin, you'll need to re-do this edit, if you overwrite this file. If the idea of editing a VBulletin core file bothers you, don't install this mod! I won't be held responsible for your forum being fouled up. This mod is very safe however, so don't fret.

Install Instructions:

1. Unzip the product-memberbot.xml file on your system.

2. Go to your VBulletin AdminCP and click on Manage Products under the Plugin Manager section.

3. Click on Add/Import Product.

4. Click on Browse on the first line (Upload the XML from your computer) and locate the product-memberbot.xml file. Click on Import to upload it to the system.

5. Click on Plugin Manager, and ensure that the new plugin named Bot Checker, which is found under the init_startup hook, is enabled.

6. Now the fun part, you'll need to edit the core VBulletin file init.php which is located in the includes directory under your forum home.

For example, if your forum home is located in /home/blah/forum, then init.php is in /home/blah/forum/includes

If you can edit the file on the server without having to download it, more power to you.

In init.php, find this line (should be near the very bottom of the file, it was line 403 in mine):

if (!empty($db->explain))

Add ABOVE this line:

if ($is_bot == 1) {
        $vbulletin->userinfo['usergroupid'] = 2;
}

NOTE: My registered users group is ID #2. Yours may be different, you may change this to any group ID you like.

7. Save init.php and upload back to your server if you had to download the file to edit it.

If you're editing on the server, save it, and that's it!

================================================== ========
That's it! Search Engine bots should now "see" your forum as a regular user, not a guest.

Questions, comments, improvements are more than welcome. Please use this thread as a cental support site. It makes it easier for me to help out. Also, you may visit my site and fire me off a PM for help, or just send a quick thanks or shout out.

Enjoy!
// trilljester

[dtv100]

Originally Posted by Los

I renamed the file to spiders_vbulletin.xml and added the code. Seems to work. How can I be sure?

go to vBulletin Options /Who's Online Options /Enable Spider Display
set to yes then go to who is online and if there spider you can see if they get permission errors.

[Welshy2008]

I have just installed this on my 3.6.8 Vs 2. How do I check that it has worked Please?

I have just tried to that "Spiderlist" through my ACP -> P&P -> Product Manage -> add/Import, but it showed as "Invalid File Specified". Is it because it is for the 3.7.2? Where as I have the 3.6.8?

I asume it is just the spiderlistXML file that I am supposed to upload?

How do I check that the upload of this hack is working for me Please? (I have been in ACP -> Who's Online Options -> Enable Spider Display -> Yes. (No spiders on at present).

When I downloaded it earlier, Google sider was on - but it was showing as a Guest (as usual). What I have done above will be seen by the members of the forum now - wouldn't it?

Many Thanks,

Welshy2008.

[andy9l]

Many thanks to dtv100 and trilljester!.

This works on 3.7.3 Patch 1 for me, this is what I did:

1. Downloaded, and installed the XML file from the original hack posted here (attached)
2. Edited the following in my init.php file (./includes/init.php)

Find:

if (!empty($db->explain))
{
	$db->timer_stop(false);
}

/*======================================================================*\

Replace with:

if ($is_bot == 1) {
        $vbulletin->userinfo['usergroupid'] = XX;
}
if (!empty($db->explain))
{
	$db->timer_stop(false);
}

/*======================================================================*\

Seems to be working for me, I don't have any spider lists or anything installed, had no problems with Admin CP or other guest/member permissions as of yet. I'll let you know if there are any problems in the future.

It's simpler than it's made out in this thread...

The above code was not written by me and all credit goes to the makers/coders here
I'm just giving a testimonial of a successful install on VB 3.7.3 - Patch 1

[Brandon Sheley]

this mod has bad idea written all over it
I would advise AGAINST using this mod, giving the bots access to more then guest will get you blacklisted in search engines in no time.

[Nassou]

Thank you very much , it work for me !

[ROTPAR]

The Problem is: Now, every non registered member who will use a firefox plugin what will identify him as google bot, will have access to all private/closed forums as guest. They don't even need to register, just by using a FF Plugin.

Is there no possibility to identify the googlebot by actual ips ?

[dxblouie]

Works on 3.8.0 as follows:
install as normal

now in includes/init.php around line #400, look for the following:

                $vbulletin->options['contactuslink'] .= $vbulletin->session->vars['sessionurl_q'];
        }
}

// CSRF Protection for POST requests
if (strtoupper($_SERVER['REQUEST_METHOD']) == 'POST')

Replace with the following:

                $vbulletin->options['contactuslink'] .= $vbulletin->session->vars['sessionurl_q'];
        }
}

// memberbot mod:
if ($is_bot == 1) {
        $vbulletin->userinfo['usergroupid'] = XX;
}
// End of memberbot mod

// CSRF Protection for POST requests
if (strtoupper($_SERVER['REQUEST_METHOD']) == 'POST')

i can see provisions for verifying the bot IP address in the mod code, but it doesn't seem to be active..

[mahakala]

thanks, i like it

to prevent missuse take a look at http://bot-trap.de - if one tries to fake, he is trapped. even so spambots and so on.

[ROTPAR]

how can i make it work on 3.8.1

[RedHacker]

How to install this in 3.8.1 .....?