Board Optimization - PubSubHubBub for vBulletin 4.x - Realtime Indexation of New Threads!

PubSubHubBub for vB 4.x.x

IF YOU LIKE THIS PLUGIN, OR ARE A FAN OF SEO, PLEASE FOLLOW ME ON TWITTER!

About PubSubHubBub (PuSH):
PubSubHubBub is a new protocol for realtime indexation of webpages. It works by pushing new content to a distributed network of PuSH compatible servers, rather than relying on a crawler hitting the board to find new content.


Is it similar to Ping-o-Matic?:
Similar yes, but PuSH works in a slightly different way, and is getting some heavyweight support from big players like wordpress who have included it on every wp.com blog.


Where can I learn More about PubSubHubBub?:
Try the official google documentation for full information.
Alternatively, watch this video by google.


How do I install it?
Simple, upload the files in the upload.zip to your forum root, and import the enclosed XML in the adminCP where you would normally import products.


A Word about Copyright:
The file push.php is NOT my copyright, it is infact copyright of InternetBrands Inc (the owners of vBulletin). It is mentioned in the file itself that it is not my copyright, and it is ONLY FOR USE BY ACTIVE LICENSE HOLDERS. I am distributing this with consent of both vBulletin and InternetBrands (see the next section for more details)


The History of This Plugin:
Its a plugin I was never going to release publicly, I use it on my seo forum and was quite happy leaving it at that. I experienced a measurable increase in spider activity, and time to indexing after getting it working for the first time.

However - D.Bradley @ Internet Brands got in touch and asked me to release it for the community.

I would also like to thank Fabian Schonholz of vBulletin.com for reviewing it and allowing the re-publication of the copyrighted material within push.php
- without those two people evangelising this plugin, I would not have released it publicly.


How do I tell if its working?
Thats proving to be a bit of a problem, the only testing tool that Im aware of for PuSH hasnt been giving stable results for the last few weeks, and other PuSH clients like the ones within wordpress.com blogs are also giving inconsistant results. I am however in touch with google who are reviewing the plugin.

In the meantime, I suggest you install the plugin, and keep an eye on two factors, 1) spider activity in google webmaster tools, and 2) time to indexation of new threads (by manual checks for now). As soon as I get some joy back from them I will update this post.


Can I remove the powered by.... accreditation link?
No. Doing so invalidates the license by which I am distributing this software.

If you must use a version without the accreditation link, I am selling this plugin in a GOLD version for just ?10 over at my plugin shop: http://seoforums.org/cart.php.

Please note, if you are using the GOLD version, you still need an active vb license to download the push.php file, which is only available on this page at vb.org.


A Word About Support:
I sometimes go a few weeks or more without coming back to vb.org so the best place to get in touch is either on http://twitter.com/seoforumsorg or on http://seoforums.org - and PM me on "MOGmartin".

[MOGmartin]

Originally Posted by ForenOpfer

Same here... What do i need to add in the only field in the settings to push an information about new posts and threads? O.o

Best Regards from Germany
ForenOpfer

Originally Posted by El Intocable

I was getting an Fatal Error after this Mod got Installed on my forum, only appear to happen when New Threads or New Post were posted in forum

Fatal error: Call to undefined function curl_init() in /home/myfreene/public_html/forums/global.php(29) : eval()'d code on line 88

So I Disable the Mod and the forum is back to Normal.
Any Ideas how to fix this issue?

By the way im on vb4.0.8 pl2

Hmmmmm... Crap. This is exactly the kind of error that prevented me from releasing this mod in the first place!

So, most other people dont have the problem, do you two have any other mod's installed that function at a posting level (ie. things that are triggered when a new post is submitted)?

[MOGmartin]

Originally Posted by Alfa1

Which search engines use this protocol? Only Google or more?

Sure, lots of companies are using it not just google, and its important to point out that Google are also using it in lots of different ways, and are only just implementing it in many "divisions".

You can check how google are doing on their pubsubhubbub progress page here:
http://code.google.com/p/pubsubhubbu...HubbubAtGoogle

Furthermore, you can see a brief list of other companies also hooked up to the PuSH infrastructure (both publishers and readers):
http://code.google.com/p/pubsubhubbub/wiki/Companies

[MOGmartin]

Originally Posted by argothiusz

Installed but there is no setting except for filling out the hub url o.O

correct. There arent really any settings, its an "on or off" deal.

Check out the official wordpress plugin, you will find that they dont even have a hub setting

[MOGmartin]

Originally Posted by Taurus1

Looks interesting. Can I use this with vBSEO?

Yes. Im using both together.

VBSEO ofcourse uses ping o matic to a similar effect, so its arguably less useful on a VBSEO enabled board, but.... Pubsubhubbub is gaining a much wider reach into the search engines (see my post a few above this one) so I think its probably worth leaving on.

[BadgerDog]

Ok, need some advice ...

Running Version 0.2 and I'm not sure what I'm supposed to be seeing as a result.

Perhaps a jump in the number of "spiders" accessing our site? If so, I think there was an improvement in that area last night, but I'm not sure.

Sorry to be so vague ...

Regards,
Doug

[MOGmartin]

Originally Posted by BadgerDog

Ok, need some advice ...

Running Version 0.2 and I'm not sure what I'm supposed to be seeing as a result.

Perhaps a jump in the number of "spiders" accessing our site? If so, I think there was an improvement in that area last night, but I'm not sure.

Sorry to be so vague ...

Regards,
Doug

Hi Doug,

see my paragraph in the original description titled: "How do I tell if its working?" - as its something that works entirely transparantly, I myself am finding it tough to give any colour to that bit!

So, over the space of a few weeks, I saw a noticeable upshift in spider activity on google webmaster tools, and I also ran lots of tests with either PuSH/PingOmatic/nothing active and measured their inclusion time in the main google index. Of the three test groups PuSH and PingOmatic were both in the <minutes range, which the "nothing" group was significantly longer (hours).

Incidently, Im waiting on google helping out on this point (as developers of wordpress PuSH plugins).

cheers

Martin

[MOGmartin]

Originally Posted by LbR

What a sexy name "PubSubHubBub"

I agree. You just cant ignore a new protocol when its so snappily named.

[BadgerDog]

Originally Posted by MOGmartin

Hi Doug,

see my paragraph in the original description titled: "How do I tell if its working?" - as its something that works entirely transparantly, I myself am finding it tough to give any colour to that bit!

Hello Martin ...

Ok, I'll keep an eye on these

1) spider activity in google webmaster tools

2) time to indexation of new threads (by manual checks for now)

Just anecdotal feedback, but I think it's possible new posts from our site are appearing faster in our Custom Google Search engine and the spider count seems to be higher as well.

Will advise when I see a definitive pattern ...

I have not had any SQL errors as reported by others here. We're running v4.04pl1 of vBulletin with a LOT of add-on mods.

Regards,
Doug

[MOGmartin]

Originally Posted by BadgerDog

Hello Martin ...

.....Will advise when I see a definitive pattern ...

Im playing about with the google CSE as well now, I dislike the native vb search functions - but am not convinced yet by the google offering. Might try out the digitalpoint sphinx search as well.

Originally Posted by BadgerDog

I have not had any SQL errors as reported by others here. We're running v4.04pl1 of vBulletin with a LOT of add-on mods.

Regards,
Doug

Me neither, Im running 4.06 with dozens of plugins, 4.1 on a test board, and 4.07 on another, with no sql problems at all. (sorry you two that did have problems, diagnosing it is a bit difficult )

[BadgerDog]

Originally Posted by MOGmartin

Im playing about with the google CSE as well now, I dislike the native vb search functions - but am not convinced yet by the google offering. Might try out the digitalpoint sphinx search as well.

I agree .. hate vBulletin's search.... :up:

I like Google's CSE we just started testing, but I do think there is a lag in how quickly content gets updated after new posts are placed. I also don't like the fact that content that's restricted to only certain user groups displays in Google's CSE. I do realize that when an unauthorized user group member clicks on that type of link, vBulletin does present the user with the crappy "unauthorized" screen, but I wish we had a way of stopping Google's CSE from displaying it in the first place.

Anyway, Digitalpoint Sphinx sounds interesting, but I'm just a 62 year old Fortran programmer out of the 1960's era, struggling to support our not-for-profit collectors site where the average demographic age is 60+ ..

So, I doubt I could handle the install of that product unless it loaded as simply and elegantly as yours.

Do you know any contractors who could quote a price for us to install and test this product?

Thanks Martin..

Regards,
Doug