Major Additions - psiStats 2006 (The New vBStats for vBulletin 3.5.x - 3.8.x)

I no longer support my hacks. Please feel free to update them and release new versions elsewhere as long as I get the credit for the original modification.

/*===================================*\
|| psiStats 2009
||
|| Author : Anton Kanevsky
|| Works on : vBulletin 3.5.x - 3.8.x
|| Released : Feb 28, 2010
||
|| Time required to install: 1 minute
|| Difficulty: easy
\*===================================*/

DESCRIPTION

A sophisticated statistics module for your vBulletin board.

This program is free software; you can redistribute it and/or
modify it under the terms of the GNU General Public License
as published by the Free Software Foundation; either version 2
of the License, or (at your option) any later version.

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
GNU General Public License for more details.

STATISTICS

File Uploads: 1
Products to Install: 1


FEATURES

Statistics Tracking:

• General Board Statistics
• Style Usage Statistics
• Top Threads & Forums Statistics
• Display Colors + Resolutions (Requires JavaScript) Statistics
• Countries + Regions Statistics
• Browsers + Operating Systems Statistics
• Referring Sites Statistics
• Referrer Statistics
• Age & Gender Demographics

Features:

• No code or template modifications required.
• Modules can be enabled or disabled, as needed.
• Statistics are updated every fifteen minutes via cron.
• Mother site, e.g. the site where your forum is hosted, will never be listed as a referrer.
• Only one extra query per forum page.
• Statistics can be sorted either numerically or alphabetically.
• Automatic Integration with Referrer Statistics (if installed)[/i]
• Configurable number of last items for top threads / forums.
• Allows to specify whether to show data from from forums with post counts disabled.
• Configurable number of last items in referring site statistics.
• Configurable gender field and responses (optional).
• Configurable list of usergroups that can access statistics (optional).
• Referring site statistics censure (by word) and individual site blockage.
• Detects most popular browsers and operating systems.
• Requires cookies for screen color depth and resolution tracking.

VERSION HISTORY

1.6.2 - stable
[+] Added recognition for Windows 7-based user agents.

1.6.1 - stable
[+] The navbar link is now shown only to those who can access the statistics.

1.6.0 - stable
[+] Added two new modules:

• Referrer Statistics
• Age & Gender Demographics

[+] Added Google Chrome recognition (this includes a matching icon).
[+] Added Setting to control whether top threads & forums data is gathered from forums where posts are not counted towards user post counts.
[+] Updated ip to country databases to the most recent ones.
[F] Corrected a few phrasing bugs and phrased things that were not phrased in 1.5.2.

1.5.2 - stable
[+] Added a few more translations (thanks to those who submitted these).
[+] Fixed a few bugs that were mentioned for 1.5.1.

1.5.1 - stable
[+] Added option to globally enable / disable any stats modules.
[+] Fixed bug with some staff being counted twice.
[+] All numbers are now nicely formatted.

1.5.0 - stable
[+] No more template edits, just upload the files and the product and you're ready to go.
[+] vBulletin 3.5.x - 3.8.x compatible.

1.4.4 - stable
[+] Referrering Sites now have a JS and an XML feed capability.
[+] Added a better firefox icon into the icon database.
[F] Fixed a couple of minor bugs.

1.4.3 - stable
[+] The hack now respects vBulletin's "Show Active Users" setting.
[+] The hack is now valid XHTML (all templates must be reverted).

1.4.2 - stable
[+] Corrected a bug, which caused incorrect number of moderators to be displayed.
[+] gb.gif renamed to uk.gif.

1.4.1 - stable
[+] The front page has been revised, and it now loads four times as fast regardless of the size of your database.
[+] The ip database has been updated to the revision of October 18, 2006.
[+] The flag database has been updated to the revision of October 18, 2006.
[+] Referrer statistics hack, if installed, is now detected automatically. No configuration required.
[+] Added an option to specify a custom board creation date, if not reflected correctly by the joindate of a user with lowest userid.

1.4.0 - stable
[+] The system is now cross-compatible with both vBulletin 3.5 and 3.6.
[+] The ip database has been updated to the revision of August 30, 2006.
[+] A variety of code optimizations and template corrections have been done.
[+] To keep statistics legible, the engine now only tracks the major and the minor browser versions. X.Y.Z.E is now stripped to become X.Y.

1.3.2 - stable
[+] Since more browsers support cookies than ajax, screendepth/screenresolution tracking is now done via cookies.
[+] One less query per page - e.g. now it's only one query per page.
[+] Statistics are now updated every 15 minutes rather than every hour.
[F] Fixed faulty count in cron and in region stats screen.
[F] Fixed bug which prevented the cron from being created in some cases.
[F] Fixed minor bugs which caused errors of the E_NOTICE level.

1.3.1 - stable
[F] Fixed AJAX coding error, which used synchronous ajax instead of asynchronous, evidently causing higher load.
[F] Fixed WOL error that was caused by AJAX stats update and that made it look like everyone is browsing the stats.
[F] Fixed a query in update cron.

1.3.0 - stable
[+] Yay, no more file edits!
[+] No more multiple queries. The hack now takes up a maximum of two (2) queries per page in contemporary browsers, and one (1) query in non-javascript browsers.
[+] New vBulletin Option: Statistics can be configured either numerically or alphabetically.
[+] Since Opera is updated way too often, the engine, from now on, will only identify the primary version marker (7,8,9 as opposed to 7.01, 7.02, 7.21, 8.01 etc).
[+] Templates and phrases are now in their own separate group.
[F] Eliminated a bug which prevented bot identification from working properly.

1.2.8 - beta
[+] Removed 5 queries during the stats recording.
[+] Countries mapped to valid cia abbreviations and the countrybit template has been updated.
[+] Added missing Fiji flag (Thanks to firstrebel!)
[F] Eliminated a bug which prevented the thread and post limit from having any effect.
[F] Eliminated a bug which prevented the browser identification from working properly in some cases.

1.2.7
[F] Corrected online users count.
[F] Corrected staff count.
[F] Eliminated the style stats bug, which originated from users who had invalid styles saved in their profiles.
[F] Eliminated the posts per day bug.
[F] Renamed "gb.gif" to "uk.gif"
[F] Renamed "Oceania" region to "Australia and Oceania".
[F] Only threads and forums to which the user has permissions are displayed in top threads and forums.

1.2.6
[F] Minor template fix.

1.2.5
[+] Rewritten Browser and OS detection (previosly somebody else's module was used).
[F] For staff stats, only primary usergroups are now counted.

1.2.1
[+] New "Usergroups Allowed To View Stats" admincp option.
[+] Navigation split in two rows, for greater view
[+] Crawlers now have a browser picture associated with them.
[F] Eliminated Tracking of Empty Referrers.
[F] Updated country database with a number of missing countries, including UK.
[F] Minor fix to style statistics screen, applying to styles that are not used.

1.2.0
First Official Release.

1.1.0
Development release; Excess queries, phrases, and code has been removed.

1.0.0
Development release; All phrases that were hard-coded were moved into the phrase system.

The installation manual is contained within the attached file.

IF YOU LIKE MY HACK, PLEASE CLICK INSTALL

[Phooey]

I'm having issues where the Display Colors & Resolutions page isn't showing any data. Everything else is working fine, it's just that page. I've double checked everything and I think I have it installed correctly.

Any suggestions?

You can see my stats page at http://www.digitallywise.com/forums/psistats.php

[Lottis]

Thank you, Psionic Vision.
This was a great product and it works great. No problem at all. Thanks and nominating.

[Lottis]

Hmm, why cant this be nominated?

[transitbus]

Edit NM Can't use this mod due to the lock issue. Oh well, looked good at the time.

[akanevsky]

Originally Posted by Phooey

I'm having issues where the Display Colors & Resolutions page isn't showing any data. Everything else is working fine, it's just that page. I've double checked everything and I think I have it installed correctly.

Any suggestions?

You can see my stats page at http://www.digitallywise.com/forums/psistats.php

Did you do template modifications?

Originally Posted by Lottis

Hmm, why cant this be nominated?

What do you mean - it can't be nominated?

As for the lock issue, why not fix it?

[transitbus]

Originally Posted by Psionic Vision

As for the lock issue, why not fix it?

Because many hosts including mine don't allow for such things (it also runs mysql 4.0.16). Lock and unlock produce loads (even if minute) on sql servers. I share a server with dozens of other clients so performance is a top concern.

Why not instead find another way that does not require people to contact their host to give them high level rights?

[Nandakal]

Originally Posted by transitbus

Because many hosts including mine don't allow for such things (it also runs mysql 4.0.16). Lock and unlock produce loads (even if minute) on sql servers. I share a server with dozens of other clients so performance is a top concern.

Why not instead find another way that does not require people to contact their host to give them high level rights?

Same, cant use it due to lock issue, had to deinstall it.

-N.

[akanevsky]

Originally Posted by transitbus

Because many hosts including mine don't allow for such things (it also runs mysql 4.0.16). Lock and unlock produce loads (even if minute) on sql servers. I share a server with dozens of other clients so performance is a top concern.

Why not instead find another way that does not require people to contact their host to give them high level rights?

Because that's the only method of locking data.

[transitbus]

Not sure why you need to use locking in the form you do for this type of database but seeing how many of us can not have that access (no everyone runs their own mysql server) and almost no other add on here uses this method, I would think you would choose a different way to make this compatible.

and I am going to quote mysql.com because I like to back up my statements with evidence

http://dev.mysql.com/doc/refman/5.0/en/lock-tables.html

Normally, you do not need to lock tables, because all single UPDATE statements are atomic; no other thread can interfere with any other currently executing SQL statement. However, there are a few cases when locking tables may provide an advantage:

• If you are going to run many operations on a set of MyISAM tables, it is much faster to lock the tables you are going to use. Locking MyISAM tables speeds up inserting, updating, or deleting on them. The downside is that no thread can update a READ-locked table (including the one holding the lock) and no thread can access a WRITE-locked table other than the one holding the lock.
  The reason some MyISAM operations are faster under LOCK TABLES is that MySQL does not flush the key cache for the locked tables until UNLOCK TABLES is called. Normally, the key cache is flushed after each SQL statement.
• If you are using a storage engine in MySQL that does not support transactions, you must use LOCK TABLES if you want to ensure that no other thread comes between a SELECT and an UPDATE. The example shown here requires LOCK TABLES to execute safely:

LOCK TABLES trans READ, customer WRITE;
SELECT SUM(value) FROM trans WHERE customer_id=some_id;
UPDATE customer
  SET total_value=sum_from_previous_statement
  WHERE customer_id=some_id;
UNLOCK TABLES;

Without LOCK TABLES, it is possible that another thread might insert a new row in the trans table between execution of the SELECT and UPDATE statements.
You can avoid using LOCK TABLES in many cases by using relative updates (UPDATE customer SET value=value+new_value) or the LAST_INSERT_ID() function. See Section 1.9.5.3, “Transactions and Atomic Operations”.
You can also avoid locking tables in some cases by using the user-level advisory lock functions GET_LOCK() and RELEASE_LOCK(). These locks are saved in a hash table in the server and implemented with pthread_mutex_lock() and pthread_mutex_unlock() for high speed. See Section 12.9.4, “Miscellaneous Functions”.

[Lottis]

Originally Posted by Psionic Vision

What do you mean - it can't be nominated?

Earlyer it was a nominating button on the hack. But now it issent.
Do we have to nominat manually now?