Usenet gateway

THIS THREAD IS CLOSED!
Posts in here will NOT be answered

This hack has undergone many major changes since this thread was started. Consequently, most of the posts have become dated and of little use. To coincide with the latest major release (20010712), a new one has been started.

See this thread for the latest version and discussion

[fastforward]

For those of you getting the error when inserting into the usenet_ref table; check your my.cnf setting for MAX_ALLOWED_PACKET.

I'll lookat rewriting that section to loop and insert each ref individually. A little less efficient, but it should provide better error trapping and correction.

It must be a configuration issue as I can't reproduce it and I collect over 60 groups on dbforums.com

[fastforward]

maxc:

I just cut and pasted your SQL statement that was giving you and error and it loaded into my database without problems.

Post the structure of your usenet_article table and give me the mysql version.

[fastforward]

Originally posted by Mark Hewitt
I removed the newgroup that was causing the trouble but it just happened on another group.
Query failed:

Looking at the SQL statement, you can see it still isn't picking up the date. Give me the newsgroup name and the date of the dodgy article and I'll have look at it. This error is in no way related to maxc's error by the way.

Excuse me,I am a Taiwanese use Tranditional Chinese,
thus,I surmise I need to edit defalt language character,can
I add Big 5 8bit(Chinese language code) into program,will
it work If I added.it.......

[fastforward]

Originally posted by maxc
Excuse me,I am a Taiwanese use Tranditional Chinese,
thus,I surmise I need to edit defalt language character,can
I add Big 5 8bit(Chinese language code) into program,will
it work If I added.it.......

Unfortunately not. The module I use only supports the ISO 8859 single-byte coded (8bit) character sets for the following:

1. Latin1 (West European)
2. Latin2 (East European)
3. Latin3 (South European)
4. Latin4 (North European)
5. Cyrillic
6. Arabic
7. Greek
8. Hebrew
9. Latin5 (Turkish)
10. Latin6 (Nordic)

Simply adding to this list will not achieve anything. I believe I need unicode support for Chinese characters (or a module that supports more of the ISO 8859 sets). I'm not sure whether more sets exist yet although I know they are planned.

Sorry about that. I will look around for another module that supports it.

Originally posted by fastforward
maxc:

I just cut and pasted your SQL statement that was giving you and error and it loaded into my database without problems.

Post the structure of your usenet_article table and give me the mysql version.

Ok... I am using MySQL v3.23.37, and My structure of usenet_article table is in the attach file.

Thanks for your help....

[fastforward]

One more thought about the Chinese cahracters:
Try just disabling the worddecoder routine. Do this:

Change line 190 that currently reads

$$art{body}=$wd->decode(join("",@$b));

to this

$$art{body}=join("",@$b);

Originally posted by fastforward

Simply adding to this list will not achieve anything. I believe I need unicode support for Chinese characters (or a module that supports more of the ISO 8859 sets). I'm not sure whether more sets exist yet although I know they are planned.

Sorry about that. I will look around for another module that supports it.

Just Ok! It didn't effect of my forum, Thank you very much!

[fastforward]

Minor release to change the way the custom email address works. This way should be more logical and prevent any user inadvertently setting their options in such a way that will display their email address in outgoing usenet posts.

It also adds some additional error checking in places.

There have been a lot of major changes in the last few versions. This includes changes to table structures and definitions. If you have remnants of installations before the version numbers were changed to a date, you should carefully go through each table and index and check the settings against the instructions. Where possible, you should drop and re-create the table.

This version has been tested on over 200 newsgroups pulling articles from 1 week ago. No errors were seen and not once was there an instance of the fields in article headers not being found. The servers used were onlynews.com and a local DNEWS server.

Download v20010505 for RC2

[Mark Hewitt]

I've changed to the new version and I'm not getting the errors I was getting before.

However some newsgroups don't seem to be fetching the articles properly.

There are some where I know for a fact there are many many new posts and yet newnews.pl is saying No new messages, together with other assorted errors.

Use of uninitialized value in addition (+) at newnews.pl line 95.
Use of uninitialized value in numeric gt (>) at newnews.pl line 95.
Getting article batch from rec.autos.sport.f1.moderated
Use of uninitialized value in numeric gt (>) at newnews.pl line 99.
Use of uninitialized value in numeric gt (>) at newnews.pl line 99.
No new messages in rec.autos.sport.f1.moderated
inserting new threads from rec.autos.sport.f1.moderated
checking for orphans...
Processing outgoing posts
Processing outgoing posts