psiStats 2006 (The New vBStats for vBulletin 3.5.x - 3.8.x)

I no longer support my hacks. Please feel free to update them and release new versions elsewhere as long as I get the credit for the original modification.

/*===================================*\
|| psiStats 2009
||
|| Author : Anton Kanevsky
|| Works on : vBulletin 3.5.x - 3.8.x
|| Released : Feb 28, 2010
||
|| Time required to install: 1 minute
|| Difficulty: easy
\*===================================*/

DESCRIPTION

A sophisticated statistics module for your vBulletin board.

This program is free software; you can redistribute it and/or
modify it under the terms of the GNU General Public License
as published by the Free Software Foundation; either version 2
of the License, or (at your option) any later version.

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
GNU General Public License for more details.

STATISTICS

File Uploads: 1
Products to Install: 1


FEATURES

Statistics Tracking:

• General Board Statistics
• Style Usage Statistics
• Top Threads & Forums Statistics
• Display Colors + Resolutions (Requires JavaScript) Statistics
• Countries + Regions Statistics
• Browsers + Operating Systems Statistics
• Referring Sites Statistics
• Referrer Statistics
• Age & Gender Demographics

Features:

• No code or template modifications required.
• Modules can be enabled or disabled, as needed.
• Statistics are updated every fifteen minutes via cron.
• Mother site, e.g. the site where your forum is hosted, will never be listed as a referrer.
• Only one extra query per forum page.
• Statistics can be sorted either numerically or alphabetically.
• Automatic Integration with Referrer Statistics (if installed)[/i]
• Configurable number of last items for top threads / forums.
• Allows to specify whether to show data from from forums with post counts disabled.
• Configurable number of last items in referring site statistics.
• Configurable gender field and responses (optional).
• Configurable list of usergroups that can access statistics (optional).
• Referring site statistics censure (by word) and individual site blockage.
• Detects most popular browsers and operating systems.
• Requires cookies for screen color depth and resolution tracking.

VERSION HISTORY

1.6.2 - stable
[+] Added recognition for Windows 7-based user agents.

1.6.1 - stable
[+] The navbar link is now shown only to those who can access the statistics.

1.6.0 - stable
[+] Added two new modules:

• Referrer Statistics
• Age & Gender Demographics

[+] Added Google Chrome recognition (this includes a matching icon).
[+] Added Setting to control whether top threads & forums data is gathered from forums where posts are not counted towards user post counts.
[+] Updated ip to country databases to the most recent ones.
[F] Corrected a few phrasing bugs and phrased things that were not phrased in 1.5.2.

1.5.2 - stable
[+] Added a few more translations (thanks to those who submitted these).
[+] Fixed a few bugs that were mentioned for 1.5.1.

1.5.1 - stable
[+] Added option to globally enable / disable any stats modules.
[+] Fixed bug with some staff being counted twice.
[+] All numbers are now nicely formatted.

1.5.0 - stable
[+] No more template edits, just upload the files and the product and you're ready to go.
[+] vBulletin 3.5.x - 3.8.x compatible.

1.4.4 - stable
[+] Referrering Sites now have a JS and an XML feed capability.
[+] Added a better firefox icon into the icon database.
[F] Fixed a couple of minor bugs.

1.4.3 - stable
[+] The hack now respects vBulletin's "Show Active Users" setting.
[+] The hack is now valid XHTML (all templates must be reverted).

1.4.2 - stable
[+] Corrected a bug, which caused incorrect number of moderators to be displayed.
[+] gb.gif renamed to uk.gif.

1.4.1 - stable
[+] The front page has been revised, and it now loads four times as fast regardless of the size of your database.
[+] The ip database has been updated to the revision of October 18, 2006.
[+] The flag database has been updated to the revision of October 18, 2006.
[+] Referrer statistics hack, if installed, is now detected automatically. No configuration required.
[+] Added an option to specify a custom board creation date, if not reflected correctly by the joindate of a user with lowest userid.

1.4.0 - stable
[+] The system is now cross-compatible with both vBulletin 3.5 and 3.6.
[+] The ip database has been updated to the revision of August 30, 2006.
[+] A variety of code optimizations and template corrections have been done.
[+] To keep statistics legible, the engine now only tracks the major and the minor browser versions. X.Y.Z.E is now stripped to become X.Y.

1.3.2 - stable
[+] Since more browsers support cookies than ajax, screendepth/screenresolution tracking is now done via cookies.
[+] One less query per page - e.g. now it's only one query per page.
[+] Statistics are now updated every 15 minutes rather than every hour.
[F] Fixed faulty count in cron and in region stats screen.
[F] Fixed bug which prevented the cron from being created in some cases.
[F] Fixed minor bugs which caused errors of the E_NOTICE level.

1.3.1 - stable
[F] Fixed AJAX coding error, which used synchronous ajax instead of asynchronous, evidently causing higher load.
[F] Fixed WOL error that was caused by AJAX stats update and that made it look like everyone is browsing the stats.
[F] Fixed a query in update cron.

1.3.0 - stable
[+] Yay, no more file edits!
[+] No more multiple queries. The hack now takes up a maximum of two (2) queries per page in contemporary browsers, and one (1) query in non-javascript browsers.
[+] New vBulletin Option: Statistics can be configured either numerically or alphabetically.
[+] Since Opera is updated way too often, the engine, from now on, will only identify the primary version marker (7,8,9 as opposed to 7.01, 7.02, 7.21, 8.01 etc).
[+] Templates and phrases are now in their own separate group.
[F] Eliminated a bug which prevented bot identification from working properly.

1.2.8 - beta
[+] Removed 5 queries during the stats recording.
[+] Countries mapped to valid cia abbreviations and the countrybit template has been updated.
[+] Added missing Fiji flag (Thanks to firstrebel!)
[F] Eliminated a bug which prevented the thread and post limit from having any effect.
[F] Eliminated a bug which prevented the browser identification from working properly in some cases.

1.2.7
[F] Corrected online users count.
[F] Corrected staff count.
[F] Eliminated the style stats bug, which originated from users who had invalid styles saved in their profiles.
[F] Eliminated the posts per day bug.
[F] Renamed "gb.gif" to "uk.gif"
[F] Renamed "Oceania" region to "Australia and Oceania".
[F] Only threads and forums to which the user has permissions are displayed in top threads and forums.

1.2.6
[F] Minor template fix.

1.2.5
[+] Rewritten Browser and OS detection (previosly somebody else's module was used).
[F] For staff stats, only primary usergroups are now counted.

1.2.1
[+] New "Usergroups Allowed To View Stats" admincp option.
[+] Navigation split in two rows, for greater view
[+] Crawlers now have a browser picture associated with them.
[F] Eliminated Tracking of Empty Referrers.
[F] Updated country database with a number of missing countries, including UK.
[F] Minor fix to style statistics screen, applying to styles that are not used.

1.2.0
First Official Release.

1.1.0
Development release; Excess queries, phrases, and code has been removed.

1.0.0
Development release; All phrases that were hard-coded were moved into the phrase system.

The installation manual is contained within the attached file.

IF YOU LIKE MY HACK, PLEASE CLICK INSTALL

[akanevsky]

So should I switch to a mysql-based IP database? Or just store the IP database in a single file? Or just make the cron run with 15 minute intervals?

Which would be most efficient?

[MPDev]

My concern there would be the number of queries needed during the execution of the script - it could add hundreds of queries during processing. I'm not sure if it helps, but I added a "unset($ranges);" after the loop where it is used to try and minimize the amount of memory being used.

I don't think a DB solution would be "better"; but will let you know if I find something better than the unset().

[akanevsky]

What about putting everything into one file?
All IP files together are worth 2.47MB on disk...

[MPDev]

I don't know about that; it all seems relative to how many records you have to process. I'm not sure I'd want to read in a 2.5mb array everytime, but I'm not sure that I'm not doing that anyways based on all the traffic I get.

[sidekick]

is there anyway i can remove the MEMBER STATS from the general statistics thing ? like i dont want it to show the first thing, abt activity and all

anyways nice hack, thanks

[bashy]

Hi Psionic

not used the admincp Referring Sites Statistics for some time now
and just decided to take a look at it and it gave me this error, Any
ideas please?

Database error in vBulletin 3.5.3:

Invalid SQL:

	SELECT *
	FROM psistats_referrer
	ORDER BY referrer;

MySQL Error  : Table 'web18_4rum.psistats_referrer' doesn't exist
Error Number : 1146
Date         : Saturday, January 14th 2006 @ 11:58:37 PM
Script       : http://www.bashys-place.com/forums/admincp/psistats_admin.php
Referrer     : http://www.bashys-place.com/forums/admincp/index.php?do=nav

[akanevsky]

@sidekick,
You edit the PSISTATS_HOME template and take out whatever you don't want to show up.

@bashy,
Make sure you upload the latest version of psistats_admin.php...

[bashy]

Thanks Psionic...
Not sure how i missed that 1 (no comments please )

All sorted again thanks

Originally Posted by Psionic Vision

@bashy,
Make sure you upload the latest version of psistats_admin.php...

[Club3G]

Quick question, should I be concerned about the performance overhead of this? I love the hack, but via webstats:

Top 30 of 926 Total URLs

# Hits KBytes URL
1 38294 4.31% 287139 5.80% /forum/image.php
2 37135 4.18% 1094015 22.09% /forum/showthread.php
3 32810 3.69% 334297 6.75% /forum/psistats.php

It's #3 on my usage list. I've had it installed for less than a week, and that's a stats snapshot of the same time period. It's not linked anywhere on my forums, I'm the only one that uses it as it takes a bit to load and slows my site down a touch when I hit it.

[akanevsky]

:banana: UPDATE 1.3.2 :banana:

1. Revert every single template created by this hack (if modified).
2. Overwrite product XML.
3. Overwrite ./psistats.php, ./includes/cron/psistats_update.php, ./includes/psistats/database_agent.php
4. Re-do template change for headinclude