Usenet gateway

THIS THREAD IS CLOSED!
Posts in here will NOT be answered

This hack has undergone many major changes since this thread was started. Consequently, most of the posts have become dated and of little use. To coincide with the latest major release (20010712), a new one has been started.

See this thread for the latest version and discussion

Fastforward, my members didn't like the usenet messages being included into the "view new posts" search, as we have a much slower traffic, so I thought it might be useful option in the CP to include or exclude usenet messages from the search new posts function. Just an idea. I intend on hacking it for the mean time to exlude usenet messages.

Originally posted by fastforward
And you are you using the latest version right?

Yes, I am using 2.3

Originally posted by tamarian
Fastforward, my members didn't like the usenet messages being included into the "view new posts" search, as we have a much slower traffic, so I thought it might be useful option in the CP to include or exclude usenet messages from the search new posts function. Just an idea. I intend on hacking it for the mean time to exlude usenet messages.

I never really thought about that actually. But you're right that must be very annoying to see all those mesages I'll add it ASAP

Gilby, I'm still looking at your problem. In the meantime, have a look in the usenet_article table at the messages that are not being inserted and look at the refs column and the ord column. Then do a search in the post table and see if one of the refs matches an inserted post AND the ord is either equal to or 1 more than an inserted post.

Also, did the missing messages originate from usenet or your forum?

Well I've just tested it on that webdiscuss news server and I managed to get all the messages from that thread with no problems. They didn't all come in in the first run though. This is because it only does one 'insert into forum' batch each time. So although all messages were retrieved and placed into usenet_article during the first run, it took three more runs to insert them correctly in order. The only other explanation is if the references weren't placed in your outgoing messgages correctly. I'll check the code in the newreply.php and newthread.php again.

On another note. I have come across a problem with the control panel if gzip is not enabled or output buffering is not on. You'll get the 'Cant add header' errors. I now see why Jelsoft didn't refresh the control panel each time a change is made. I'll look into fixing that tomorrow.

Now I am puzzled. I did a clean install of the forums (imported the original DB that had no posts, etc. into a new DB) and imported the rec.sport.unicycling newsgroup and now I only have 15 messages in the usenet_article table and when I look at it, there are reasons that I see that they were not inserted. Stuff like "Re(2):" or "Re: [Re:" are in the subject and some of those have no refs (so the orphan replies code doesn't associate a ref for it). Earlier today, I had 52 messages in the usenet_article table and most looked like they shouldn't have had the problems. I also downloaded the latest zip of the hack and replaced the newnews.pl script with the one I had (which was version 2.3, but from before the addslashes() fix was put into the code replacements which I didn't think affected the newnews.pl file). Another thing I did was set it for just the one newsgroup without using the multiple servers since you mentioned the bug with that (although I never saw that particular bug, and you deleted it from your post). So, now it appears to work. Thanks for looking into this problem and sorry about trouble.

Anyways, I think a feature that would be nice to help with posts not being inserted would be to have a feature in the control panel where the posts that are still in the usenet_article table are listed and then have an option to choose a thread to put it into. This would help with the posts that have weird subject lines since one unrecognized post makes all the child posts get stuck as well.

More reports:

1. I got one duplicate message inserted (has same poster and title) but has no body:

Here's the empty one:

http://www.lowcarber.org/forum/showt...&threadid=1379

Here's the one that's not empty:

http://www.lowcarber.org/forum/showt...&threadid=1373

2. CP Stats includes usenet posts, which more than tripled my daily stats. This is just cosmetic suggestion to not include usenet posts in stats or give them their own stats.

3. For some reason the 2.3 newnews.pl doesn no pull news articles, it just displays connected and then "clean disconnect" When I run the 2.1 version it polls articles properly. I currently have the 2.3 installation of the hack, but my cron job uses the 2.1 version of newnews.pl.

Originally posted by tamarian
1. I got one duplicate message inserted (has same poster and title) but has no body:

This is probably a duplicate post on usenet aswell. There is nothing that can be done about that. The script should check to see if the message is completely blank and not insert it if it is.

2. CP Stats includes usenet posts, which more than tripled my daily stats. This is just cosmetic suggestion to not include usenet posts in stats or give them their own stats.

Believe it or not, I've never actually looked at that option in the CP. I think I tried it once in beta 1 and it didn't work so I never looked again I'll fix that sometime soon.

3. For some reason the 2.3 newnews.pl doesn no pull news articles, it just displays connected and then "clean disconnect" When I run the 2.1 version it polls articles properly. I currently have the 2.3 installation of the hack, but my cron job uses the 2.1 version of newnews.pl.

This should not be happening. You may introduce other problems by using an old version of newnews.pl. Even if there are no messages it should tell you. The only reason I can think of is if all newsgroups are turned off in the control panel. Version 2.1 doesn't check for this but 2.3 does. If this is the problem give yourself a slap!

Originally posted by Gilby
Another thing I did was set it for just the one newsgroup without using the multiple servers since you mentioned the bug with that (although I never saw that particular bug, and you deleted it from your post).

It turned out the problem was actually caused by the server name not being saved. The default one is saved correctly, but any custom. per newsgroup entries were never inserted into the settings table. This was fixed a few minutes after I posted yesterday. It was just a small edit in the usenet.php file.

Originally posted by fastforward
If this is the problem give yourself a slap!

Slap!