vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vBulletin 3.0 Full Releases (https://vborg.vbsupport.ru/forumdisplay.php?f=33)
-   -   NNTP Gateway for Usenet ( Newsgroups ), Mailing Lists (https://vborg.vbsupport.ru/showthread.php?t=65152)

lierduh 06-23-2004 12:40 AM

Quote:

Originally Posted by Cold Steel
Ok, I made a post http://forums.asiansinc.com/showthre...054#post476054 but for some reason it gave me a 500 error when running gateway.php.

So I disabled signatures and tried again, same result.

See attached.

The error must be your original problem. You may need to do a manual post following the instruction in the first page, ie. ssh, telnet etc. Basically your news server does not know the posting command sent by gateway script. 1) Are you allowed to post? 2) Have you changed the script, especially nntp.php?

Cold Steel 06-23-2004 12:43 AM

I am going to try the SSH instruction on the front now.

1) I should be allowed to post, since some posts have gone through before through gateway.php.

2) The only modifications I made were the ones you suggested to gateway.php.

If you have the time, would you mind getting on some sort of instant messaging client?

Cold Steel 06-23-2004 12:49 AM

Hmm. Both telnet and Agent tell me that I'm not allowed to post...


Very odd.

fustanella 06-23-2004 12:49 AM

Quote:

Originally Posted by AWS
On Windows create a scheduled task.

Just to clarify, did you mean a task within the Windows operating system, or within the task manager built into vB3? I took you to mean the former, and when I tried it I couldn't get it to work; just now, though, I stumbled across the latter and it appears to be doing the trick each hour.

Cold Steel 06-23-2004 01:54 AM

Forget it - I signed for a free account with Teranews which is letting me post.

Qwest 06-23-2004 01:54 AM

Quote:

Originally Posted by fustanella
Just to clarify, did you mean a task within the Windows operating system, or within the task manager built into vB3? I took you to mean the former, and when I tried it I couldn't get it to work; just now, though, I stumbled across the latter and it appears to be doing the trick each hour.

I find it better to use the one on teh Operating system if you can. The one in VB is based on visitors to your site. If you site has lulls in traffic your task won't be run until someone visits.

Qwest 06-23-2004 02:04 AM

Everyone I found out how to make the posts not count towards your total board post counts.

Note: this hack is totally the work of Wayne Luke. I'm just copy/pasting

Quote:

Originally Posted by Wayne Luke
Should be easy...

Add a smallint field on the database record such as "is_usenet" and set it to '1' for the forums that are.

Then in index.php find the following code (it is near the bottom):
PHP Code:

if (is_array($forumcache))
{
    foreach (
$forumcache AS $forum)
    {
        
$totalthreads += $forum['threadcount'];
        
$totalposts += $forum['replycount'];
    }


And change it to:
PHP Code:

if (is_array($forumcache))
{
    foreach (
$forumcache AS $forum)
    {
            if (!
$forum['is_usenet']) {
                     
$totalthreads += $forum['threadcount'];
                
$totalposts += $forum['replycount'];
                }
    }



My only addition is that you have to go into your AdminCP and update post counts for the changes to take affect. Try running gateway.php as well.

kkiely 06-23-2004 03:46 AM

Hi, could everyone who runs a board with USENET access reply as to
1. what news account you are using
2. how much it costs
3. how many GB you get/month
4. how reliaable it is

I have a few questions

1. What is your favorite news account?

2. If someone wants to run 2 different web sites using VBulleting with the USENET hack - can they use the same news feed and share the bandwidth?

3. Do most webmasters here find that the cost of the news account is worth the extra traffic, etc?

4. Can you make it so that anyone who posts to Usenet through your board has a signature in their posts that read something like

______________________________
"This was posted at www.ABC.com"

Cold Steel 06-23-2004 03:51 AM

1. I was using Giganews (the link is my referral link). But for some reason, they stopped letting me post.

So I went to Teranews.com. They let me post once, and then none of them were getting through.

2. Giganews is $7.99 a month. Teranews is only a $3.95 setup fee.

3. Giganews is 2GB a month. Teranews is 50MB a day.

4. Both unreliable if you ask me, although I would think Giganews is more reliable than Teranews.

1. No favorite yet.

2. Yes.

3. Just started. Don't know yet.

4. Don't know.

I'm starting to think this is more trouble than it's worth.

Help!!!

KevinM 06-23-2004 04:50 PM

Quote:

Originally Posted by princeton
If I understand correctly you are suppose to add the first line of the footer between { } and it should strip the remaining lines -- is this correct?
:(

There are a couple of things to check first (I'm sure you have, but just to be sure...) as these are insensitive to any tolerance.

Double check that this bit
PHP Code:

    //strip the footer from emails only
        
if ($grouptype != 'news')
        {
        
$message['text'] = stripfooter($message['text']);
        } 

has been entered in the right place in gateway.php.

Lastly, check that the new Varname you entered in the controlpanel is called exactly "emailfooter" (without quotes).

Try to keep what you put between the {} as short as possible, but enough that it won't occur naturally in a normal message. What is the phrase you are trying to match? Are there any unusual characters that may cause the script to hiccup?

Princeton 06-23-2004 06:49 PM

thanks kevin,
I did a clean install and everything is working as it should.

However the "preview" hack doesn't work. It's not fetching $postid.
Taken from partial error report
Code:

SET firstpostid =
It would be great to have an option to modify past posts that have "unwanted footers".

Hey, no one has responded to a post I created a few days ago ... in regards to $subject. It needs to be wrapped in htmlspecialchars() - - some titles may have html in it.

thanks again

Cold Steel 06-23-2004 07:09 PM

I figured out why giganews suspended my posting privileges.

Someone sent in a complaint about one of the posts that one my users made.

:(

Princeton 06-23-2004 07:12 PM

Quote:

Originally Posted by Cold Steel
I figured out why giganews suspended my posting privileges.

Someone sent in a complaint about one of the posts that one my users made.

:(

that's why it would be good to have an option to disable upload (to newsgroup/mlist) of postings made within the forum

KevinM 06-23-2004 08:04 PM

Quote:

Originally Posted by princeton
However the "preview" hack doesn't work.

?5 says it does :nervous:

Princeton 06-23-2004 08:08 PM

well ... it doesn't work for me. :ermm:

I'll look again ... it was working before.

john_rsd 06-23-2004 10:19 PM

I have just installed this mod and I am having trouble getting it to run.

First i tried NNTP and that failed.

So then i tried to collect from a pop3 mail account and I got this error when running gateway.php for the first time.

I am sure I did not make an error as the installation is pretty straight forward.

Quote:

Gateway version 2.1.0 1 group(s) gatewayed. Could not connect to NNTP-serverNot connectedNot connected


There seems to have been a slight problem with the Forums database.
Please try again by pressing the refresh button in your browser.

An E-Mail has been dispatched to our Technical Staff, who you can also contact if the problem persists.

We apologise for any inconvenience.
If ran from scheduled task manager in vb3

Quote:

Database error in vBulletin 3.0.1:

Invalid SQL: UPDATE nntp_settings
SET value =
WHERE varname = 'last_postid'
mysql error: You have an error in your SQL syntax. Check the manual that corresponds to your MySQL server version for the right syntax to use near 'WHERE varname = 'last_postid'' at line 3

mysql error number: 1064

Date: Wednesday 23rd of June 2004 04:17:56 PM
Script: http://www.proteluser.com/bbs3/admin...cron&cronid=13
Referer: http://www.proteluser.com/bbs3/admincp/index.php
Username: Site_Admin
IP Address: 217.43.199.18
Otherwise the forums work OK

Any help apprciated.

john_rsd 06-23-2004 11:15 PM

Sorry, it was my own fault, email works now.

But I have another few questions on some things I would like to do.

The mail list that i am backing up requires registration to post and the backup i will make on the forum should be read only. i don't want to spam the list with test messages to try this one out so i thought i would ask.

If I simply change the forum permissions to prevent usergroups from being able to post/reply for that forum, should that be sufficient to stop forum users from using the email gateway to post messages to the mail list server?

Also when messages are delivered they sometimes are prefixed "RE:...." or "FW:...." Can these characters be stripped?
If I could strip things like FW: and RE: I could forward old messages to test threading etc (which does not seem to work).
Each post has a fixed name enclosed with suqare brackets always, like [listname]

Any help appreciated

BustaCap 06-24-2004 01:10 AM

Quote:

Originally Posted by john_rsd
Sorry, it was my own fault, email works now.


If I simply change the forum permissions to prevent usergroups from being able to post/reply for that forum, should that be sufficient to stop forum users from using the email gateway to post messages to the mail list server?

Yes, that will work.

Quote:

Originally Posted by john_rsd
Also when messages are delivered they sometimes are prefixed "RE:...." or "FW:...." Can these characters be stripped?
If I could strip things like FW: and RE: I could forward old messages to test threading etc (which does not seem to work).

Use KevinM's hack to thread properly and that will get rid of the "RE's".


Quote:

Originally Posted by john_rsd
Each post has a fixed name enclosed with suqare brackets always, like [listname]

You can get rid of those by using the Replacement Variable Manager. Go to your Admin CP, select Styles and Templates, then Replacement Variable Manager. For the style you want this to apply to, select add new replacement variable, then enter the text you want removed (eg, [yourlistname]), and leave the replacement blank. That will do the trick. Note, the text isn't actually stripped, it's just hidden from view.

Cold Steel 06-24-2004 01:59 AM

Quote:

Originally Posted by princeton
that's why it would be good to have an option to disable upload (to newsgroup/mlist) of postings made within the forum

What is the point of having newsgroups in the forums, then? Just another content source?

john_rsd 06-24-2004 10:56 AM

Cheers Dave

I applied Kevins mod, but it seems erratic. As the mail list is not public and the posts spread reasonably evenly across the day I do not think its a server issue.

Screenshot is below.

A couple of posts were threaded correctly, then some were not, then another 2, then some were not.

Perhaps related to time received? I think the threaded mod should filter by subject no problem regardless of when it is received, if i read the functions correct, or is the filtering done after messsages are batch downloaded or per message. The mail server from which it collects the messages is the same as the site is hosted on, so no delays there.

you can see from the list that one subject was threaded OK (after Kevins mod) then another, but the posts after that were not, even although subject lines were identical.

Any ideas?

BustaCap 06-24-2004 12:19 PM

That's what my posts looked like before I applied Kevin's hack. Double check your gateway.php file and make sure you followed the directions exactly. Also, run gateway.php manually, copy and paste what the screen log shows, and post it here.

Princeton 06-24-2004 01:24 PM

Quote:

Originally Posted by Cold Steel
What is the point of having newsgroups in the forums, then? Just another content source?

Some of the information in mlist is very valuable; however, if you or a member does something wrong you can be removed/banned. I would like the option to prevent posting to mlist for this very reason. A forum member will always be able to post to the forum - it just won't be sent to the public mlist.

ARCHIVE - for information only; some of the content found in newsgroup/mlist can answer posted questions on forum (similar threads)

KevinM 06-24-2004 01:51 PM

Quote:

Originally Posted by princeton
I'll look again ... it was working before.

If you still can't get it working, post the 10 lines from gateway.php just before this mini-hack and I'll have a look.

KevinM 06-24-2004 01:56 PM

Quote:

Originally Posted by john_rsd
I applied Kevins mod, but it seems erratic. As the mail list is not public and the posts spread reasonably evenly across the day I do not think its a server issue.

From your screenshot, that is exactly the problem that this mini-hack fixes. It picks these up by their subject title and threads correctly where the reference in the email header is missing.

Like BustaCap say, check the installation in gateway.php, and if you still have problems post the output here.

Princeton 06-24-2004 02:39 PM

I got it working ... thank you. :up:

Princeton 06-24-2004 07:19 PM

Kevin,
I never get this error when I call the file directly. However, I do occasionally get this error when Schedule Task runs the file.
[sql]Invalid SQL: INSERT INTO post
(postid, threadid, title, username, userid, dateline,
pagetext, allowsmilie, showsignature, ipaddress,

iconid, visible, isusenetpost, msgid, ref, parentid)
VALUES (NULL, ,
'',
'', 0,
'',
'', 1, 0,
'', 0, 1, 1,
'',
'',
+ 0)
mysql error: You have an error in your SQL syntax. Check the manual that corresponds to your MySQL server version for the right syntax to use near '
'',
'', 0,
'',
'', 1, 0,
'', 0, 1, 1[/sql]
(I direct this to you (kevin) because it only happens when I use your mini hack.)

john_rsd 06-24-2004 08:31 PM

Kevin

Today it was working and I have not changed the gateway.php file.

Output from running from inside AdminCP

Quote:

Gateway version 2.1.0 1 group(s) gatewayed. Successfully connected to the 'mail.rsdtv.com' pop3 server Retrieving 6 E-mails from the 'mail.rsdtv.com' pop3 server Getting message number 1: '[dxp] OT: Differential Stripline Impedance' from Jason Morgan. New thread. Getting message number 2: 'Re: [dxp] show footprint on schematic' from Don Lucas. Thread found by Subject Title. Getting message number 3: 'Re: [dxp] [dxp]: Junction Printing Error' from Don Lucas. Thread found by Subject Title. Getting message number 4: 'Re: [dxp] PCB manufacturing via internet?' from Don Lucas. Thread found by Subject Title. Getting message number 5: 'Re: [dxp] PCB manufacturing via internet?' from Richard Pender. Thread found by Subject Title. Getting message number 6: 'Re: [dxp] PCB manufacturing via internet?' from Don Lucas. Thread found by Subject Title.
I set this up as a scheduled task in the AdminCP to run every 15 minutes but it seems to have no effect, I have to push it manually to run. If I tried to run it directly from the browser I got an error that it was already running so I have set the check in AdminCP to 1 now.

However it seems the ones before failed to match (title '2004 simulator ops') see attachment

KevinM 06-24-2004 09:10 PM

Quote:

Originally Posted by john_rsd
However it seems the ones before failed to match (title '2004 simulator ops') see attachment

It looks to be working correctly. The thread that you mention looks like a duplicate post (it has no "Re: " in the title), so the correct action is to start a new thread.

It will only search for a match by subject title under the following circumstances:

1. There are no references in the header that match an exisiting thread

AND

2. There is at least one "Re: " in the subject title, which gives an indication that there should be a parent thread for this post.

The output from gateway.php which you have shown also indicates that it is working correctly.

KevinM 06-24-2004 09:21 PM

Quote:

Originally Posted by princeton
(I direct this to you (kevin) because it only happens when I use your mini hack.)

It's hard to tell from the sql query what is causing it to fail. If it ever happens when you are running gateway manually, make a copy & post the output which was running at the time.

Are you running the 'threading by subject' hack? There was an error in my first release which caused the $parentid not to generate, which would produce a error like the one you have. It was corrected with this version shortly afterwards:https://vborg.vbsupport.ru/showpost....&postcount=181

john_rsd 06-24-2004 09:26 PM

Kevin

Could it be that some users have just removed the subject prefix (or their mail clients have not added one?) . I have not used any other mail clients except Eudora or Outlook and these both addd it.

So in order for the threading function to be initiated it checks the first chars of the subject feild for matches on 'RE' ? Then parses an subject index for a match?

Guess its not case sensitive?

BTW, thanks for this really cool mod :)

KevinM 06-24-2004 09:39 PM

Quote:

Originally Posted by john_rsd
Kevin
So in order for the threading function to be initiated it checks the first chars of the subject feild for matches on 'RE' ? Then parses an subject index for a match?

The primary method of matching threads is by a reference number which is inthe headers of newsgroup posts and emails. This was written by Lierduh and is highly effective. All newsgroups thread pretty much perfectly just by this method.

Some mail groups (my personal experience is with Yahoo groups) do not reliably put the reference number in the header of the email, therefore I wrote a secondary check (case insensitive!) which checks again before starting a new thread. The "Re: " can appear anywhere in the subject title.

If you really, really have problems, you can find in the script where it searches for "Re: " and change it to "", and it will search every post that comes through for a subject match. This WILL slow things down, and will also match a thread from (say) 3 years ago if it has the same title. This is completely untested (and not recommended) as the basic threading will pick up most of them.

Quote:

Originally Posted by john_rsd
BTW, thanks for this really cool mod

Lierduh cooked the Sunday roast, I just made some gravy :cheeky:

john_rsd 06-24-2004 10:09 PM

Thanks Kevin

I undestand a little better now, so ill dig deeper.

the source of the list is a private server using Lyris, its not yahoo or anything like that.

I might try using"" as this list server only has 50 or so posts a day so is never busy enough to slow the server down.

Also if using "" it should only d/l message that are in the pop3 box so it might not cause a flood.

The roast and the gravy make a fine combo mate, sweet :)

john_rsd 06-24-2004 10:39 PM

Oh nuts

Just seen the glitch again

This time i ran the script directly

Quote:

Gateway version 2.1.0 1 group(s) gatewayed.
Successfully connected to the 'mail.proteluser.com' pop3 server
Retrieving 4 E-mails from the 'mail.proteluser.com' pop3 server
Getting message number 1:
'Re: [dxp] OT: Differential Stripline Impedance' from Ian Wilson. New thread.
But this was a reply to an earlier one and has Re in it

Header from first messsage/thread

Quote:

Return-Path: <bounce-dxp-3338@forums.altium.com>
Delivered-To: rsdtvcom-john@rsdtv.com
Received: (qmail 97607 invoked from network); 24 Jun 2004 17:25:39 -0000
Received: from unknown (HELO 203.10.94.132) (203.213.65.162)
by host109.ipowerweb.com with SMTP; 24 Jun 2004 17:25:39 -0000
Content-Class: urn:content-classes:message
MIME-Version: 1.0
Content-Type: text/plain;
charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
X-MimeOLE: Produced By Microsoft Exchange V6.0.6249.0
Subject: [dxp] OT: Differential Stripline Impedance
Date: Thu, 24 Jun 2004 18:18:34 +0100
Message-ID: <LYRIS-3338-45721-2004.06.25-03.13.39--john#rsdtv.com@forums.altium.com>
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
Thread-Topic: OT: Differential Stripline Impedance
Thread-Index: AcRaEGUknFNjWsP/Qper0ZkkCMrRLA==
From: "Jason Morgan" <jason.morgan@citel.com>
To: "DXP Technical Forum" <dxp@forums.altium.com>
List-Unsubscribe: <mailto:leave-dxp-3338F@forums.altium.com>
Reply-To: "DXP Technical Forum" <dxp@forums.altium.com>
Header from reply messsage

Quote:

Return-Path: <bounce-dxp-3338@forums.altium.com>
Delivered-To: rsdtvcom-john@rsdtv.com
Received: (qmail 69724 invoked from network); 24 Jun 2004 23:30:20 -0000
Received: from unknown (HELO 203.10.94.132) (203.213.65.162)
by host109.ipowerweb.com with SMTP; 24 Jun 2004 23:30:20 -0000
Message-Id: <LYRIS-3338-45752-2004.06.25-09.17.27--john#rsdtv.com@forums.altium.com>
X-Sender: i.wilson@considered.com.au@mail.considered.com.au@127.0.0.1
X-Mailer: QUALCOMM Windows Eudora Version 5.2.0.9
Date: Fri, 25 Jun 2004 09:25:28 +1000
To: "DXP Technical Forum" <dxp@forums.altium.com>
From: Ian Wilson <i.wilson@considered.com.au>
Subject: Re: [dxp] OT: Differential Stripline Impedance
In-Reply-To: <LYRIS-395-45721-2004.06.25-03.13.39--i.wilson#considered.c
om.au@forums.altium.com>
Mime-Version: 1.0
Content-Type: text/plain; charset="us-ascii"; format=flowed
List-Unsubscribe: <mailto:leave-dxp-3338F@forums.altium.com>
Reply-To: "DXP Technical Forum" <dxp@forums.altium.com>
Is this because the Message ID is different? Or is the filter being confused between ID's in the reply and only seeing the first one (different) and not the second one (match)

John

vprp 06-24-2004 11:02 PM

When I run gateway.php, I get the message:

Gateway version 2.1.0 1 group(s) gatewayed.
Could not connect to NNTP-serverNot connectedNot connected

What's the problem?

I am trying to do this for the newsgroup rec.sport.golf

Princeton 06-24-2004 11:48 PM

Quote:

Originally Posted by vprp
When I run gateway.php, I get the message:

Gateway version 2.1.0 1 group(s) gatewayed.
Could not connect to NNTP-serverNot connectedNot connected

What's the problem?

I am trying to do this for the newsgroup rec.sport.golf

you are not allowed to access newsgroup via script or you have settings wrong (username/password if required).

I remommend you do a test first.
Use-------
- msnews.microsoft.com as SERVER
- microsoft.public.security as NEWSGROUP

NOTE: add 58700 as LAST MESSAGE or check the XREF # in header of last message found in usergroup.

vprp 06-24-2004 11:50 PM

I tried that microsoft newsgroup and i got the same message. should i try to reinstall?

Princeton 06-24-2004 11:52 PM

I still get the message.
And ... yes, I am using the code posted on that POST.

Would you care to see the file?
I've made some "visual/html" modifcations to the file ... however, everything is clearly marked where the changes have been made (your mini-hacks , etc,)

Princeton 06-24-2004 11:53 PM

Quote:

Originally Posted by vprp
I tried that microsoft newsgroup and i got the same message. should i try to reinstall?

yes, start from scratch ... make sure you read the instructions carefully

john_rsd 06-25-2004 02:15 PM

Anyone else using email delivery method and found problems with the script crashing?

I have been sending most things I could think of at the script and it has crashed twice, big time.

The first time was when a message was forwarded to the lists, the forward contained multiple forwarded messages and no subject. In this case the first message was part entered into the database (with no subject filled in) but nothing on the rest.

The second time was when a message was sent to the lists with no subject, perhaps it was still recovering from the first crash.

I might go back and try the nntp feed instead of email.

Imhotep 06-27-2004 02:01 AM

:ermm: My forums stopped grabbing new Usenet messages on 6/21. I'm trying to finger out exactly where the log jam has occured. My cron job is still going off like clockwork.

This is the entire content of my cron results minus the header garbage.

Code:

Gateway version 2.1.0  4 group(s) gatewayed.

Connecting to server, server says: 200 News.GigaNews.Com

Server responded after user name: 381 more authentication required

Server responded after password: 281 News.GigaNews.Com

Info for comp.graphics.apps.lightwave at news-40.giganews.com:
211 12589 237200 249788 comp.graphics.apps.lightwave

Getting message number 249690:


Any ideas as to what is happening? It looks like it only hits one group... then stops. ? :ermm:


All times are GMT. The time now is 09:15 PM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01713 seconds
  • Memory Usage 1,906KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (2)bbcode_code_printable
  • (3)bbcode_php_printable
  • (26)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (4)pagenav_pagelink
  • (1)pagenav_pagelinkrel
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (40)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete