vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vBulletin 3.5 Add-ons (https://vborg.vbsupport.ru/forumdisplay.php?f=113)
-   -   vBouncer: reduce server load by unsubscribing bouncing members from threads (https://vborg.vbsupport.ru/showthread.php?t=83486)

tamarian 07-02-2005 07:23 PM

Quote:

Originally Posted by Paul M
What or who would I set the owner to ? I have fixed it on my test server by changing one line in the exim.conf file - but this may not be possible if you are not on a dedicated server.

Change it to the apache user apache:apache (or if apache runs as nobody, then nobody:nobody).

Note that I'm not recommending people do this :) But it's worth it just to see if that's the culprit.

tamarian 07-02-2005 07:37 PM

Version 0.9 is out. New features added:

o Collect logs via IMAP/POP or mail spool file
o Custom filters to match patterns in bounced emails

To upgrade, uninstall, then reinstall through the installation script.

Paul M 07-02-2005 07:58 PM

Quote:

Originally Posted by tamarian
Change it to the apache user apache:apache (or if apache runs as nobody, then nobody:nobody).

Note that I'm not recommending people do this :) But it's worth it just to see if that's the culprit.

Nope, exim still manages to change it back to 666 - but with the exim config change, it works for me - so I'm happy.

There is always the pop method if people cannot do this. :)


Btw, there is an error in the vbouncer-clean.php ;

PHP Code:

                elseif ($DemoteUg$db->query_write("UPDATE  " TABLE_PREFIX "user 
                        set usergroupid = " 
$vbulletin->options['vbouncer_auto_ug_destination'] . " where userid='$stats[uid]"); 

There is a stray quote after where userid=

tamarian 07-02-2005 08:08 PM

Quote:

Originally Posted by Paul M
There is a stray quote after where userid=

Thanks, fixed and uploaded.

Can you write a summary for what cPanel+Exim config needs to be changed, so the spool becomes readable/writable? I'll just add it to the how-to with your name, for those who can (and want to) change their Exim config.

Christine 07-02-2005 08:24 PM

Quote:

Originally Posted by tamarian
cPanel access is not needed, but would love to test the POP module on an Exim. So if you have a POP account that has bounced emails (or empty and not being used), please PM me the access info :)

Will do.

I have not installed this on my new server that is now serving as my test site (as of Sunday) and I am still getting it set up.

What all do I need to do to set this up -- just apply the hack, or do I need to do any of Paul's addons?

Paul M 07-02-2005 08:25 PM

Quote:

Originally Posted by tamarian
Can you write a summary for what cPanel+Exim config needs to be changed, so the spool becomes readable/writable? I'll just add it to the how-to with your name, for those who can (and want to) change their Exim config.

In the exim config file ( /etc/exim.conf ), near the bottom is a section that begins with virtual_userdelivery: - in that section is a line which says mode = 0660 - change this to mode = 0666 . Then chmod the inbox file to 666 as I previously mentioned (and the directory structure leading to it as previously described).

Christine 07-02-2005 08:25 PM

Paul,

Are you running exiscan-clamav or clamav connector or anything similar?

Thanks!

Paul M 07-02-2005 08:28 PM

Quote:

Originally Posted by Christine
Paul,

Are you running exiscan-clamav or clamav connector or anything similar?

Thanks!

Never heard of it, so I guess not. :)

tamarian 07-02-2005 08:31 PM

Quote:

Originally Posted by Christine
Will do.

I have not installed this on my new server that is now serving as my test site (as of Sunday) and I am still getting it set up.

What all do I need to do to set this up -- just apply the hack, or do I need to do any of Paul's addons?

Yes, just install the new vBouncer (0.9), and wait it for it to collect some bounced emails. You can test the POP yourself first. If there are problems with th ePOP method, I'll take a look.

tamarian 07-02-2005 08:39 PM

Quote:

Originally Posted by Paul M
In the exim config file ( /etc/exim.conf ), near the bottom is a section that begins with virtual_userdelivery: - in that section is a line which says mode = 0660 - change this to mode = 0666 . Then chmod the inbox file to 666 as I previously mentioned (and the directory structure leading to it as previously described).

Cool, the how-to is updated. Let me know if I messed it up :)

Christine 07-02-2005 09:01 PM

Quote:

Originally Posted by Paul M
Never heard of it, so I guess not. :)

They are Exim filters for viruses.

Tamarian -- will get that set up for you tonight when the guys at my host finish with the kernel upgrade (that should have been done when it was configured :speechless: ).

If my results differ from Paul's, please note that I am running ClamAV, so we may need to document that.

tamarian 07-02-2005 09:10 PM

Quote:

Originally Posted by Christine
They are Exim filters for viruses.

Tamarian -- will get that set up for you tonight when the guys at my host finish with the kernel upgrade (that should have been done when it was configured :speechless: ).

If my results differ from Paul's, please note that I am running ClamAV, so we may need to document that.

If you use the POP/IMAP method, the Exim config edit is not required, since you will not need to access the spool file directly.

I'll write up any Exim hints and tips you guys give me, since you have the cPanel+Exim setup. :)

Christine 07-03-2005 03:20 PM

Sent you a PM with some setup thoughts.

Do have a question on this though -- what does it do with bounced emails from new registrations? We delete registrations whose emails bounce and I don't want those to be included in the same tracking/warning as the ones who are subscribing to threads.

Second question -- does this (or will it plan to) address those who have email notifications on PMs in that it will remove this flag from their profile? I would even go as far as to say that if their email is bad, I would like ALL subscriptions and email notifications to be disabled.

tamarian 07-03-2005 04:02 PM

Quote:

Originally Posted by Christine
Do have a question on this though -- what does it do with bounced emails from new registrations? We delete registrations whose emails bounce and I don't want those to be included in the same tracking/warning as the ones who are subscribing to threads.

You can exclude usergroups from the settings menu under "Protected usergroups" (to prevent usergroup changes" Or under "Untouchable usergroups" to prevent any actions such unsubscribing or PM's.

But if they register with a wrong email, you'd only get 1 or two bounces. If your bounce limit is 25 or 50, they wouldn't be affected.

Quote:

Second question -- does this (or will it plan to) address those who have email notifications on PMs in that it will remove this flag from their profile? I would even go as far as to say that if their email is bad, I would like ALL subscriptions and email notifications to be disabled.
It's doable if you guys really want it.

But the main purpose for vBouncer is to prevent server spikes due to the volume of emails generated during busy hours for new replies and subsequent notifications of new replies. Reducing this volume through unsubscribing bouncing members is the main purpose.

An occasional email to notify about a PM doesn't have that impact on the server

tamarian 07-03-2005 09:51 PM

Update on the MD5 idea to check for forged bounced emails:

So far it seems most bounced emails will return the full original headers. The only exception I've seen so far is AOL, and only in the case when the AOL member in question rejects emails from your forum (i.e they are blocking your email from getting into their mail box.

So currently my upcoming version does the following:

1. Adds a new setting to enter your MD5 encryption string. If you leave it empty, it will not send the new header, and will process bounced emails as authentic. So it acts like an enable/disable option.

2. If you enter an MD5 encryption string, it will send the header out with outgoing email, but it will only check for them depending on the rules you set in vbouncer.inc pattern config file. This is done to allow the check to be turned on and off based on each pattern defined. If you define a pattern for AOL-sender-block (already defined in vbouncer.inc), you can set the check to no, so it will not ignore tham due to lack of the header.

3. If an MD5 header is defined, and the pattern requires the MD5 header, then it will ignore/skip bounced emails that do not have the header, or have the header but it did not match the MD5 key.

4. No additional manual queue to seperate which is which, since it's quite controllable by the settings, and only a small percentage (less than 1%) of bounced emails (in my logs at least) fall under this case.

So this is tested and running right now and ready for release as 1.0, let me know what you think.

Paul M 07-04-2005 12:42 AM

I think I should read you post more carefully next time, I just re-installed it expecting to see this :(

tamarian 07-04-2005 12:51 AM

Quote:

Originally Posted by Paul M
I think I should read you post more carefully next time, I just re-installed it expecting to see this :(

LOL, c'mon, you don't even need to wait, I expect you already have a separate branch with a working version :) I plan to release it tomorrow, just wanted to confirm the stats with a decent sample of bounces.

Paul M 07-04-2005 12:51 AM

I also get the following in my ACP

Warning: imap_open(): Couldn't open stream in /admincp/vbouncer.php on line 143

I'm not using the POP/IMAP option.

tamarian 07-04-2005 12:53 AM

Quote:

Originally Posted by Paul M
I also get the following in my ACP

Warning: imap_open(): Couldn't open stream in /admincp/vbouncer.php on line 143

I'm not using the POP/IMAP option.

You mean in the diagnostics page? That should be fine, I just thought I'll let it show everything that can work or not work, regardless of chosen option, for fiagnostic purposes.

Paul M 07-04-2005 12:57 AM

Um, okay - it's a bit distracting getting an error message for something I don't use.

Anyway, the diagnostics show this ;

vbouncer.ini file exists = Passed
vbouncer.ini file is readable = Passed

But the cron log shows this : vbounce.ini not found, or empty. Only processing standard reports.

The file in the zip, which I uploaded appears to be called vbouncer.inc (not ini)

merk 07-04-2005 01:04 AM

use a @ before the function :p

tamarian 07-04-2005 01:16 AM

Quote:

Originally Posted by Paul M
Um, okay - it's a bit distracting getting an error message for something I don't use.

Anyway, the diagnostics show this ;

vbouncer.ini file exists = Passed
vbouncer.ini file is readable = Passed

But the cron log shows this : vbounce.ini not found, or empty. Only processing standard reports.

The file in the zip, which I uploaded appears to be called vbouncer.inc (not ini)

Ah, just the text is wrong, but the code reads and looks for vbouncer.inc. The file should be in includes/cron, and readable. Did the task run from the admincp task manager, or via regular cron?

tamarian 07-04-2005 01:17 AM

Quote:

Originally Posted by merk
use a @ before the function :p

Yes, I just thought since the script is being run by admins, it's best not to hide any errors, since it might help explain problems if/when they occure. :)

Paul M 07-04-2005 01:35 AM

Quote:

Originally Posted by tamarian
Ah, just the text is wrong, but the code reads and looks for vbouncer.inc. The file should be in includes/cron, and readable. Did the task run from the admincp task manager, or via regular cron?

From the task manager. I can't repeat it though, strange.

tamarian 07-04-2005 09:04 PM

- July 4, 2005 v1.0 Added encrypted header for authentication (suggested by Paul M).

To upgrade, uninstall, then re-install and re-upload all files.
Also, delete the existing plugin, and then re-import it, if you want to use the encrypted header.

pran 08-12-2005 02:10 PM

This is really a neat idea! Well, I download the package and installed it to an 3.5.0 RC2 board. Everything went fine except when running the cron jobs. I get this error:
Code:

Fatal error: Call to a member function on a non-object in /forums/includes/functions.php on line 4240

tamarian 08-12-2005 02:48 PM

Quote:

Originally Posted by pran
This is really a neat idea! Well, I download the package and installed it to an 3.5.0 RC2 board. Everything went fine except when running the cron jobs. I get this error:
Code:

Fatal error: Call to a member function on a non-object in /forums/includes/functions.php on line 4240

Do you also get this error when running other vB cron tasks? This error seem to occur whenever I run any task from the task manager.

pran 08-12-2005 03:00 PM

Hmm... yes, I get this error when I run other vB cron tasks. What could be wrong?

Boofo 08-12-2005 03:03 PM

It seems to be a vb bug, from what I have seen on the com. ;)

tamarian 08-12-2005 03:15 PM

Quote:

Originally Posted by pran
Hmm... yes, I get this error when I run other vB cron tasks. What could be wrong?

It's a vB bug, and here's the fix:

http://www.vbulletin.com/forum/bugs3...=931&status=20

Also, I will need to make a change to the vBouncer cron files to mach the new vB cron changes, I'll upload them shortly as v1.3 :)

tamarian 08-12-2005 03:26 PM

- August 12, 2005 v1.3 Update to the cron files to match new changes in vB's cron/tasks in 3.5 RC2. To upgrade, just re-upload the contents of includes/cron in the vBouncer zip file.

Boofo 08-12-2005 04:18 PM

Quote:

Originally Posted by tamarian
It's a vB bug, and here's the fix:

http://www.vbulletin.com/forum/bugs3...=931&status=20

Also, I will need to make a change to the vBouncer cron files to mach the new vB cron changes, I'll upload them shortly as v1.3 :)

You're welcome. )

pran 08-12-2005 11:50 PM

Quote:

Originally Posted by tamarian
- August 12, 2005 v1.3 Update to the cron files to match new changes in vB's cron/tasks in 3.5 RC2. To upgrade, just re-upload the contents of includes/cron in the vBouncer zip file.

Wow! Thanks for the quick update. BTW, what instances would the header change to the vBouncer e-mail address? Outgoing e-mails from my server is still www@fqdn.

tamarian 08-13-2005 12:46 AM

Quote:

Originally Posted by pran
Wow! Thanks for the quick update. BTW, what instances would the header change to the vBouncer e-mail address? Outgoing e-mails from my server is still www@fqdn.

vBouncer will NOT change the "From:" header. It only changes/adds a "Return-To:" header.

pran 08-14-2005 11:21 PM

Strange... I tried sending a test e-mail but I couldn't find "Return-To:" anywhere in the header.

tamarian 08-14-2005 11:29 PM

Quote:

Originally Posted by pran
Strange... I tried sending a test e-mail but I couldn't find "Return-To:" anywhere in the header.

Did you view the full headers, and what was there? Was the plugin activated?

pran 08-15-2005 12:10 AM

Here's the full headers.
Code:

Microsoft Mail Internet Headers Version 2.0
Received: from mx1-out.bitstop.ph ([202.91.161.137]) by rizal.dagupan.com with Microsoft SMTPSVC(6.0.3790.1830);
        Mon, 15 Aug 2005 06:21:18 +0800
Received: from irc.dagupan.com (irc.dagupan.com [202.91.161.246])
        by mx1-out.bitstop.ph (Postfix) with ESMTP id 95F33198432
        for <xxxxx@dagupan.com>; Mon, 15 Aug 2005 06:19:57 +0800 (PHT)
Received: by irc.dagupan.com (Postfix, from userid 80)
        id A3A7472DF1; Mon, 15 Aug 2005 06:20:18 +0800 (PHT)
To: xxxxx@dagupan.com
Subject: vBulletin Email Test
From: "kuro@bitstop.ph" <kuro@bitstop.ph>
Message-ID: <200508142218.ad0678745254@www.kuro.ph>
MIME-Version: 1.0
Content-Type: text/plain; charset="ISO-8859-1"
Content-Transfer-Encoding: 8bit
X-Priority: 3
X-Mailer: vBulletin Mail via PHP
Date: Mon, 15 Aug 2005 06:20:18 +0800 (PHT)
Return-Path: www@irc.dagupan.com
X-OriginalArrivalTime: 14 Aug 2005 22:21:18.0781 (UTC) FILETIME=[7E2BAED0:01C5A11E]


tamarian 08-15-2005 12:15 AM

Quote:

Originally Posted by pran
Here's the full headers.
Code:

Return-Path: www@irc.dagupan.com

Yes, that's the one :) Just make sure it only used for bounced emails (i.e. different than the webmaster email)

pran 08-15-2005 01:28 AM

Not quite -- I've defined vbouncer-notify[at]kuro.ph for the return path, not www[at]irc.dagupan.com

tamarian 08-15-2005 02:13 AM

Quote:

Originally Posted by pran
Not quite -- I've defined vbouncer-notify[at]kuro.ph for the return path, not www[at]irc.dagupan.com

Is the plugin active?


All times are GMT. The time now is 05:21 AM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01600 seconds
  • Memory Usage 1,855KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (4)bbcode_code_printable
  • (1)bbcode_php_printable
  • (25)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (4)pagenav_pagelink
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (40)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete