psiStats 2006 (The New vBStats for vBulletin 3.5.x - 3.8.x)

I no longer support my hacks. Please feel free to update them and release new versions elsewhere as long as I get the credit for the original modification.

/*===================================*\
|| psiStats 2009
||
|| Author : Anton Kanevsky
|| Works on : vBulletin 3.5.x - 3.8.x
|| Released : Feb 28, 2010
||
|| Time required to install: 1 minute
|| Difficulty: easy
\*===================================*/

DESCRIPTION

A sophisticated statistics module for your vBulletin board.

This program is free software; you can redistribute it and/or
modify it under the terms of the GNU General Public License
as published by the Free Software Foundation; either version 2
of the License, or (at your option) any later version.

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
GNU General Public License for more details.

STATISTICS

File Uploads: 1
Products to Install: 1


FEATURES

Statistics Tracking:

• General Board Statistics
• Style Usage Statistics
• Top Threads & Forums Statistics
• Display Colors + Resolutions (Requires JavaScript) Statistics
• Countries + Regions Statistics
• Browsers + Operating Systems Statistics
• Referring Sites Statistics
• Referrer Statistics
• Age & Gender Demographics

Features:

• No code or template modifications required.
• Modules can be enabled or disabled, as needed.
• Statistics are updated every fifteen minutes via cron.
• Mother site, e.g. the site where your forum is hosted, will never be listed as a referrer.
• Only one extra query per forum page.
• Statistics can be sorted either numerically or alphabetically.
• Automatic Integration with Referrer Statistics (if installed)[/i]
• Configurable number of last items for top threads / forums.
• Allows to specify whether to show data from from forums with post counts disabled.
• Configurable number of last items in referring site statistics.
• Configurable gender field and responses (optional).
• Configurable list of usergroups that can access statistics (optional).
• Referring site statistics censure (by word) and individual site blockage.
• Detects most popular browsers and operating systems.
• Requires cookies for screen color depth and resolution tracking.

VERSION HISTORY

1.6.2 - stable
[+] Added recognition for Windows 7-based user agents.

1.6.1 - stable
[+] The navbar link is now shown only to those who can access the statistics.

1.6.0 - stable
[+] Added two new modules:

• Referrer Statistics
• Age & Gender Demographics

[+] Added Google Chrome recognition (this includes a matching icon).
[+] Added Setting to control whether top threads & forums data is gathered from forums where posts are not counted towards user post counts.
[+] Updated ip to country databases to the most recent ones.
[F] Corrected a few phrasing bugs and phrased things that were not phrased in 1.5.2.

1.5.2 - stable
[+] Added a few more translations (thanks to those who submitted these).
[+] Fixed a few bugs that were mentioned for 1.5.1.

1.5.1 - stable
[+] Added option to globally enable / disable any stats modules.
[+] Fixed bug with some staff being counted twice.
[+] All numbers are now nicely formatted.

1.5.0 - stable
[+] No more template edits, just upload the files and the product and you're ready to go.
[+] vBulletin 3.5.x - 3.8.x compatible.

1.4.4 - stable
[+] Referrering Sites now have a JS and an XML feed capability.
[+] Added a better firefox icon into the icon database.
[F] Fixed a couple of minor bugs.

1.4.3 - stable
[+] The hack now respects vBulletin's "Show Active Users" setting.
[+] The hack is now valid XHTML (all templates must be reverted).

1.4.2 - stable
[+] Corrected a bug, which caused incorrect number of moderators to be displayed.
[+] gb.gif renamed to uk.gif.

1.4.1 - stable
[+] The front page has been revised, and it now loads four times as fast regardless of the size of your database.
[+] The ip database has been updated to the revision of October 18, 2006.
[+] The flag database has been updated to the revision of October 18, 2006.
[+] Referrer statistics hack, if installed, is now detected automatically. No configuration required.
[+] Added an option to specify a custom board creation date, if not reflected correctly by the joindate of a user with lowest userid.

1.4.0 - stable
[+] The system is now cross-compatible with both vBulletin 3.5 and 3.6.
[+] The ip database has been updated to the revision of August 30, 2006.
[+] A variety of code optimizations and template corrections have been done.
[+] To keep statistics legible, the engine now only tracks the major and the minor browser versions. X.Y.Z.E is now stripped to become X.Y.

1.3.2 - stable
[+] Since more browsers support cookies than ajax, screendepth/screenresolution tracking is now done via cookies.
[+] One less query per page - e.g. now it's only one query per page.
[+] Statistics are now updated every 15 minutes rather than every hour.
[F] Fixed faulty count in cron and in region stats screen.
[F] Fixed bug which prevented the cron from being created in some cases.
[F] Fixed minor bugs which caused errors of the E_NOTICE level.

1.3.1 - stable
[F] Fixed AJAX coding error, which used synchronous ajax instead of asynchronous, evidently causing higher load.
[F] Fixed WOL error that was caused by AJAX stats update and that made it look like everyone is browsing the stats.
[F] Fixed a query in update cron.

1.3.0 - stable
[+] Yay, no more file edits!
[+] No more multiple queries. The hack now takes up a maximum of two (2) queries per page in contemporary browsers, and one (1) query in non-javascript browsers.
[+] New vBulletin Option: Statistics can be configured either numerically or alphabetically.
[+] Since Opera is updated way too often, the engine, from now on, will only identify the primary version marker (7,8,9 as opposed to 7.01, 7.02, 7.21, 8.01 etc).
[+] Templates and phrases are now in their own separate group.
[F] Eliminated a bug which prevented bot identification from working properly.

1.2.8 - beta
[+] Removed 5 queries during the stats recording.
[+] Countries mapped to valid cia abbreviations and the countrybit template has been updated.
[+] Added missing Fiji flag (Thanks to firstrebel!)
[F] Eliminated a bug which prevented the thread and post limit from having any effect.
[F] Eliminated a bug which prevented the browser identification from working properly in some cases.

1.2.7
[F] Corrected online users count.
[F] Corrected staff count.
[F] Eliminated the style stats bug, which originated from users who had invalid styles saved in their profiles.
[F] Eliminated the posts per day bug.
[F] Renamed "gb.gif" to "uk.gif"
[F] Renamed "Oceania" region to "Australia and Oceania".
[F] Only threads and forums to which the user has permissions are displayed in top threads and forums.

1.2.6
[F] Minor template fix.

1.2.5
[+] Rewritten Browser and OS detection (previosly somebody else's module was used).
[F] For staff stats, only primary usergroups are now counted.

1.2.1
[+] New "Usergroups Allowed To View Stats" admincp option.
[+] Navigation split in two rows, for greater view
[+] Crawlers now have a browser picture associated with them.
[F] Eliminated Tracking of Empty Referrers.
[F] Updated country database with a number of missing countries, including UK.
[F] Minor fix to style statistics screen, applying to styles that are not used.

1.2.0
First Official Release.

1.1.0
Development release; Excess queries, phrases, and code has been removed.

1.0.0
Development release; All phrases that were hard-coded were moved into the phrase system.

The installation manual is contained within the attached file.

IF YOU LIKE MY HACK, PLEASE CLICK INSTALL

[MPDev]

Fatal error: Allowed memory size of 50331648 bytes exhausted (tried to allocate 46 bytes) in /home/sites/extremefitness/web/forum/includes/psistats/database_ip/217.php on line 1622

hmmmmm.... More than 50mb? Wow.

ini_set("max_execution_time", 0);
ini_set("memory_limit", "128M");

in psistats_update.php was needed.

[GamerJunk.net]

I removed the class_core edit...yet I don't know what other edits there were....

Because my avatars are messed up and there is no updates....even after manualy running psistats_update.php

[GamerJunk.net]

Vision do you have a copy of the old version so I can manually go back and remove all edits, because reverting templates would be bad for me because I have custom templates and edits.

[DementedMindz]

i still get no stats to show up... i guess i may have to uninstall this one...

[MThornback]

Originally Posted by DementedMindz

i still get no stats to show up... i guess i may have to uninstall this one...

Too buggy for my tastes...and reverting for every update (which for awhile there was hourly)....I don't think so....I like most of your hacks....and they work great, but this one i'm uninstalling.....

[MPDev]

North America and US IP addresses do not appear to be working properly; I have almost no US traffic being reported whereas before the update it was 70% of my traffic. The stats for IPs also seem low, I'm not so sure this section is working very well and identifying countries as well as it was in the previous version. (I have 6x the traffic from Trinidad and Tobago than the US according to my current stats!)

One thing to check if you get no stats - if you already had a cron job #14, the insert for this cron would have failed and you'd never get a stats update. I would suggest putting a NULL in place of the 14 as cron's cronid field is an auto increment and you do not need to specify the cron job number.

INSERT INTO cron
VALUES ( NULL, 1136665500, -1, -1, -1, 'a:1:{i:0;i:25;}', './includes/cron/psistats_update.php', 1, 'psiStats 2006 Hourly Update' )

[MPDev]

More IP info. I get data like this (when printing out some added debug code to see them $item['count'] for each entry:

211540739 -> US -> 1 ->17
212681730 -> US -> 1 ->17
214962100 -> US -> 1 ->17
215641169 -> US -> 1 ->17
215650894 -> US -> 1 ->17
215630563 -> US -> 1 ->17
215698855 -> US -> 1 ->17
215837282 -> US -> 1 ->17
215915896 -> US -> 1 ->17
201656985 -> US -> 1 ->17
2097169078 -> JP -> 1 ->17
2155237942 -> US -> 3 ->17
2157127178 -> US -> 2 ->17

and this line:

                                        $updatecache["country_||_$coucode"] = array($existingcache["country_||_$coucode"]['count'], $item['count'], $existingcache["country_||_$coucode"]['cmisc']);

Would seemingly only be adding 1 to the value, not 1 for every instance of US in the list.

I changed it to this:

                                if (isset($database_country["$coucode"]))
                                {
                                        $item['count'] += $updatecache["country_||_$coucode"][1];
                                        $updatecache["country_||_$coucode"] = array($existingcache["country_||_$coucode"]['count'], $item['count'], $existingcache["country_||_$coucode"]['cmisc']);
                                }
                                break;

So that multiple "US" (or any other) entries would have a cumulative effect on the total. This appears to be working, however, your historial data prior to this change will be very inaccurate and should be erased.

I also added line for all the other totals - I'm working to confirm this is works.

                                // MDP
                                $itemcnt = $item['count'] + $updatecache["browser_||_$browser[bstring]"][1];
                                $updatecache["browser_||_$browser[bstring]"] = array($existingcache["browser_||_$browser[bstring]"]['count'], $itemcnt, $existingcache["browser_||_$browser[bstring]"]['cmisc']);
                                
                                // MDP
                                $itemcnt = $item['count'] + $updatecache["os_||_$browser[os]"][1];
                                $updatecache["os_||_$browser[os]"] = array($existingcache["os_||_$browser[os]"]['count'], $itemcnt, $existingcache["os_||_$browser[os]"]['cmisc']);

                                        // MDP
                                        $item['count'] += $updatecache["referrer_||_$item[cdata]"][1];
                                        $updatecache["referrer_||_$item[cdata]"] = array($existingcache["referrer_||_$item[cdata]"]['count'], $item['count'], $existingcache["referrer_||_$item[cdata]"]['cmisc']);

                                        // MDP
                                        $item['count'] += $updatecache["screendepth_||_$depthstring"][1];
                                        $updatecache["screendepth_||_$depthstring"] = array($existingcache["screendepth_||_$depthstring"]['count'], $item['count'], $existingcache["screendepth_||_$depthstring"]['cmisc']);

                                // MDP
                                $item['count'] += $updatecache["screenresolution_||_$item[cdata]"][1];
                                $updatecache["screenresolution_||_$item[cdata]"] = array($existingcache["screenresolution_||_$item[cdata]"]['count'], $item['count'], $existingcache["screenresolution_||_$item[cdata]"]['cmisc']);

[SmEdD]

MPDev, thanks that fixed it with me. I am just curious why we should do it to the rest of them as well as I have had no problem . . .

[MPDev]

I added them just to be sure, I didn't want to run verifications across each data type to see if there are cases where more than 1 record exists for each item.

i.e. if the browser cache has more than one entry per browser (as there was more than one entry per country), then the numbers in the browser cache are also not correct. If there is only 1 browser record, 1 os record, then it wouldn't be a problem.

However, I am faily sure my Windows XP stats were way too low, so I added it to be sure.

[SmEdD]

LOL @ Win XP . . . I didn't even relize it but mine are really low too. Thanks for the fixes and hope you get your search string text ported over soon.