Usenet gateway

THIS THREAD IS CLOSED!
Posts in here will NOT be answered

This hack has undergone many major changes since this thread was started. Consequently, most of the posts have become dated and of little use. To coincide with the latest major release (20010712), a new one has been started.

See this thread for the latest version and discussion

[webhost]

ok did it we will see what happens. I tried to setup a cron job today earlier to run script every 20 minutes but got a error back back stating it could not run file.
Do you mind if I ask what is the string you use for cron, I can try that and see if that works.

Joey

[webhost]

forgot to mention this is the way I have one newsgroup set up.

newsgroup name alt.php
server name msnews.microsoft.com

is this correct?

Joey

[fastforward]

Originally posted by webhost
Do you mind if I ask what is the string you use for cron, I can try that and see if that works.

This is what I use to run the script every 2 hours

0 0,2,4,6,8,10,12,14,16,18,20,22 * * * nice -10 /home/dbforums/newnews.pl >/dev/null 2>&1

You'll have to make sure that the user the cron job runs under hs permissions to run newnews.pl.

[webhost]

This is what I get

[/home/realweb/public_html]# ./newnews.pl
Connecting to msnews.microsoft.com... Connected
Processing outgoing posts
Getting article batch from alt.php
No new messages in alt.php
inserting new threads from alt.php
checking for orphans...
Processing outgoing posts
Connecting to Msnews.microsoft.com... Connected
Processing outgoing posts
Getting article batch from microsoft.public.frontpage.client
Fetching headers of articles 205 to 304...
Processing headers for article 206... Not available.
Processing headers for article 207... Not available.
Processing headers for article 208... Not available.
Processing headers for article 209... Not available.
Processing headers for article 210... Not available.
Processing headers for article 211... Not available.
Processing headers for article 212... Not available.
Processing headers for article 213... Not available.
Processing headers for article 214... Not available.
Processing headers for article 215... Not available.
Processing headers for article 216... Not available.
Processing headers for article 217... Not available.
Processing headers for article 218... Not available.
Processing headers for article 219... Not available.
Processing headers for article 220... Not available.
Processing headers for article 221... Not available.
Processing headers for article 222... Not available.
Processing headers for article 223... Not available.
Processing headers for article 224... Not available.
Processing headers for article 225... Not available.
Processing headers for article 226... Not available.
Processing headers for article 227... Not available.
Processing headers for article 228... Not available.
Processing headers for article 229... Not available.
Processing headers for article 230... Not available.
Processing headers for article 231... Not available.
Processing headers for article 232... Not available.
Processing headers for article 233... Not available.
Processing headers for article 234... Not available.
Processing headers for article 235... Not available.
Processing headers for article 236... Not available.
Processing headers for article 237... Not available.
Processing headers for article 238... Not available.
Processing headers for article 239... Not available.
Processing headers for article 240... Not available.
Processing headers for article 241... Not available.
Processing headers for article 242... Not available.
Processing headers for article 243... Not available.
Processing headers for article 244... Not available.
Processing headers for article 245... Not available.
Processing headers for article 246... Not available.
Processing headers for article 247... Not available.
Processing headers for article 248... Not available.
Processing headers for article 249... Not available.
Processing headers for article 250... Not available.
Processing headers for article 251... Not available.
Processing headers for article 252... Not available.
Processing headers for article 253... Not available.
Processing headers for article 254... Not available.
Processing headers for article 255... Not available.
Processing headers for article 256... Not available.
Processing headers for article 257... Not available.
Processing headers for article 258... Not available.
Processing headers for article 259... Not available.
Processing headers for article 260... Not available.
Processing headers for article 261... Not available.
Processing headers for article 262... Not available.
Processing headers for article 263... Not available.
Processing headers for article 264... Not available.
Processing headers for article 265... Not available.
Processing headers for article 266... Not available.
Processing headers for article 267... Not available.
Processing headers for article 268... Not available.
Processing headers for article 269... Not available.
Processing headers for article 270... Not available.
Processing headers for article 271... Not available.
Processing headers for article 272... Not available.
Processing headers for article 273... Not available.
Processing headers for article 274... Not available.
Processing headers for article 275... Not available.
Processing headers for article 276... Not available.
Processing headers for article 277... Not available.
Processing headers for article 278... Not available.
Processing headers for article 279... Not available.
Processing headers for article 280... Not available.
Processing headers for article 281... Not available.
Processing headers for article 282... Not available.
Processing headers for article 283... Not available.
Processing headers for article 284... Not available.
Processing headers for article 285... Not available.
Processing headers for article 286... Not available.
Processing headers for article 287... Not available.
Processing headers for article 288... Not available.
Processing headers for article 289... Not available.
Processing headers for article 290... Not available.
Processing headers for article 291... Not available.
Processing headers for article 292... Not available.
Processing headers for article 293... Not available.
Processing headers for article 294... Not available.
Processing headers for article 295... Not available.
Processing headers for article 296... Not available.
Processing headers for article 297... Not available.
Processing headers for article 298... Not available.
Processing headers for article 299... Not available.
Processing headers for article 300... Not available.
Processing headers for article 301... Not available.
Processing headers for article 302... Not available.
Processing headers for article 303... Not available.
Processing headers for article 304... Not available.
Processing article batch...
Requested 0 messages... 0 not available or rejected.

inserting new threads from microsoft.public.frontpage.client
checking for orphans...
Processing outgoing posts

Joey

[webhost]

Ok fastforward here goes. I have run from shell the script about 15 times . I still do not have any posts downloaded still states they are not available. I can see them in outlook express though so I know there is messages there. I did however post a thread to one of the forums and it did upload it and it did show up on the newsgroup in outlook express. So that is working. Waht can I do about receiving messages?

Joey

[fastforward]

That's because your news server is not reporting the message number correctly. The first time the script is ran, it requests the first message number from the news server. Your news server is obviously reporting zero. This causes the script to start at number zero. As you can see, those messages are not available.

Access the news server using a news reader client such as xnews and make a note of the earliest message number in the groups you are interested in. Then manually set the message numbers via the control panel.

[NgtCrwlr]

Ah hah, activity in the usenet gateway channel, this is a good sign.

Paul, dare I ask how the next version is coming?

Please don't forget to work on the moderated post glitch. I'm still not letting my members use the gateway until I can moderate the usenet postings.

Also, please double check the HTML::Entities routine again, I'm still having problems with unescaped characters in the subjects. Everything is working fine on vBulletin's end it's only on the incoming posts from newnews.pl that there is a problem.

If you are too busy to get to this for a while yet, please post a few hints on where in vB or newnews that the moderated post fix would go. I will gladly hack away at it, I just need to be led by the nose a bit.

Cheers!

[fastforward]

Originally posted by NgtCrwlr
Ah hah, activity in the usenet gateway channel, this is a good sign.

Paul, dare I ask how the next version is coming?

Please don't forget to work on the moderated post glitch. I'm still not letting my members use the gateway until I can moderate the usenet postings.

Also, please double check the HTML::Entities routine again, I'm still having problems with unescaped characters in the subjects. Everything is working fine on vBulletin's end it's only on the incoming posts from newnews.pl that there is a problem.

If you are too busy to get to this for a while yet, please post a few hints on where in vB or newnews that the moderated post fix would go. I will gladly hack away at it, I just need to be led by the nose a bit.

Cheers!

I've added a basic x-noarchive handler. It simply gives you the option to ignore them and not download them. The problem is, this will cause problems with following posts not being included due to the issues mentioned a few days ago. I'm trying to figure the easiest way to handle this with minimum changes.

All outgoing posts will now honour the vB moderation routines, ie. no post will be posted if it is pending moderation.

As for the escaped characters, have you checked these posts using a normal newsreader? You may find they look the same. if that is the case, there's not much the script can do.

In conclusion, when I fix the problem of threads being 'stopped' when a post is rejected, I'll release the next version. I have every intention on working on it this week.

[webhost]

Well finally got to say it fetched 6 articles but they don't show up anywhere on my board. Don't know where they went. Fetched article 200 through 205 and then 206 through 298 were not available. I checked on forum under the forum I had setup nothing, looked in phpmyadmin nothing. I am able to send threads to newsgroups from board fine I just can not receive any from them. Maybe someone could help me with this tomorrow. Been working on it all day and my eyes are tired. Any ideas drop me a line.
Good night

I'm wopped/

Joey

[NgtCrwlr]

Originally posted by fastforward
As for the escaped characters, have you checked these posts using a normal newsreader? You may find they look the same. if that is the case, there's not much the script can do.

In conclusion, when I fix the problem of threads being 'stopped' when a post is rejected, I'll release the next version. I have every intention on working on it this week.

Excellent news Paul, I have a smile ear to ear.

On the entities deal, all we need is to parse the subject line so that it is stored with escaped ampersands, quotes, greater/less than symbols, etc. I looked at newnews.pl and only see one entry for entities.

around line 309
decode_entities($f); decode_entities($s);


Hehehe, while I was typing this out, I thought... get off your lazy duff and figure it out. I think I have done just that, I'm off to test my therory. Be back in a flash with the results.