|
For those of you getting the error when inserting into the usenet_ref table; check your my.cnf setting for MAX_ALLOWED_PACKET.
I'll lookat rewriting that section to loop and insert each ref individually. A little less efficient, but it should provide better error trapping and correction. It must be a configuration issue as I can't reproduce it and I collect over 60 groups on dbforums.com |
maxc:
I just cut and pasted your SQL statement that was giving you and error and it loaded into my database without problems. Post the structure of your usenet_article table and give me the mysql version. |
Quote:
|
Excuse me,I am a Taiwanese use Tranditional Chinese,
thus,I surmise I need to edit defalt language character,can I add Big 5 8bit(Chinese language code) into program,will it work If I added.it....... |
Quote:
Sorry about that. I will look around for another module that supports it. |
Quote:
Thanks for your help.... |
One more thought about the Chinese cahracters:
Try just disabling the worddecoder routine. Do this: Change line 190 that currently reads Code:
$$art{body}=$wd->decode(join("",@$b));Code:
$$art{body}=join("",@$b); |
Quote:
|
Minor release to change the way the custom email address works. This way should be more logical and prevent any user inadvertently setting their options in such a way that will display their email address in outgoing usenet posts.
It also adds some additional error checking in places. There have been a lot of major changes in the last few versions. This includes changes to table structures and definitions. If you have remnants of installations before the version numbers were changed to a date, you should carefully go through each table and index and check the settings against the instructions. Where possible, you should drop and re-create the table. This version has been tested on over 200 newsgroups pulling articles from 1 week ago. No errors were seen and not once was there an instance of the fields in article headers not being found. The servers used were onlynews.com and a local DNEWS server. Download v20010505 for RC2 |
I've changed to the new version and I'm not getting the errors I was getting before.
However some newsgroups don't seem to be fetching the articles properly. There are some where I know for a fact there are many many new posts and yet newnews.pl is saying No new messages, together with other assorted errors. Code:
Use of uninitialized value in addition (+) at newnews.pl line 95. |
Quote:
I can't reproduce the errors and I've pulled countless newsgroups including rec.motorcycles.racing that was giving you problems. Have you changed Perl versions recently? Did you do a *complete* fresh install? Is anyone else having these problems. The only way to troubleshoot your problem would be if I had access to you machine and newserver. Let me try anaother fresh install on another server and I'll see if I can re-produce the errors. Give me a few hours. |
OK.. Here's another one. I rechecked the entire code and errorchecking. I installed it on a fresh vB on two different servers
There realy isn't much else I can do. All I suggest is you make a completely fresh install, DO NOT make any code changes except the bit to add the control panel. Add the basic configuration settings, but leave most of the settings as the default. Then run the script. Change the settings and/or and add the code changes one by one if you need them and see where the errors start occuring. Download v20010506 for RC2 |
Just reinstalled it... it loops after reading in the headers...
Connecting to #######... Connected Processing outgoing posts Getting article batch from ###### Fetching headers of articles 1 to 23... Processing headers for article 2... Processing headers for article 3... Processing headers for article 4... Processing headers for article 5... Processing headers for article 6... Processing headers for article 7... Processing headers for article 8... Processing headers for article 9... Processing headers for article 10... Processing headers for article 11... Processing headers for article 12... Processing headers for article 13... Processing headers for article 14... Processing headers for article 15... Processing headers for article 16... Processing headers for article 17... Processing headers for article 18... Processing headers for article 19... Processing headers for article 20... Processing headers for article 21... Processing headers for article 22... Processing headers for article 23... Fetching article body 2... OK Fetching article body 3... OK Fetching article body 4... Not fetched - Spam Fetching article body 5... OK Fetching article body 6... OK Fetching article body 7... OK Fetching article body 8... OK Fetching article body 9... OK Fetching article body 10... OK Fetching article body 11... OK Fetching article body 12... OK Fetching article body 13... OK Fetching article body 14... OK Fetching article body 15... OK Fetching article body 16... OK Fetching article body 17... OK Fetching article body 18... OK Fetching article body 19... OK Fetching article body 20... OK Fetching article body 21... OK Fetching article body 22... Not fetched - Spam Fetching article body 23... Not fetched - Binary post Processing article batch... Requested 22 messages... 3 not available or rejected. inserting new threads from cast.testing checking for orphans... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... loading 1 replies... And just keeps going.... I suggest NOT looking for the Lines: ## in the NG posts... Did you know that the posts added FROM the forum dont have a Lines: ## in the header? Can we disable the option that looks to see if Lines: exsists... |
Its fixed now.. I dumped the ref table... But now.. why doesnt the posts from the FORUMS insert a "Lines: ##" line into the header?
|
Quote:
All posts have the 'Lines:' in the header regardless of their source. It is added by the news server along with all the other stuff that a client news reader can't be trusted to add. As for the looping problem, have you made several runs and reset article numbers without clearing out the usenet load tables? I suggest you clear out your usenet_article, usenet_article_loader and usenet_ref tables and see if it happens again. It will continue to loop as long as it finds articles that are ready for loading. You should see several of these 'loading replies' messages in sussession usually with decreasing numbers. It will then attempt to load the article into the forum. Whether it fails or succeeds to insert the post into the forum is irrelevant, it will be deleted from the loader table. So there are only a few logical scenarios for this error to occur.
|
Ok Cool...
Im using Cnews.. and it isnt adding the Lines: ## their from the posts coming off the Forums... Im guessing there is a config file somewhere to enable it... Maybe you want to take that into condiseration... If it doesnt find a Lines: then it should do something other consider it a binary.. Just a suggestion.. GREAT HACK :) It will be used. |
Quote:
You say the server isn't adding the Lines field. As you mention, it is probably a configuration issue. What about other articles, or are you receiving a full IHAVE usenet feed? If it's just acting as a client to an upstream news server then you will probably see the Lines header on all other posts. If the issue is only with articles that are posted directly to your cnews server then there's not really a problem as when that message is propogated to another server, the field will be added. The other point of course is why would we care if forum posts have it or not. They don't even get parsed by that code. We don't need to check them as we're not even downloading them. :) |
OK I run my own newsgroups.. I am not a client.. I am a Server.
Lets say people post to the forums and I have to delete all the posts for some reason... when I go to download all the messages again it skips past all the ones created from the forums because there is no Lines: ## Line. |
Hey!! it works, and I didn't change anything either. Thanks fastforward for all your help. I must have got quite boring over the past couple of weeks.
Just a couple of questions on how posts appear on usenet. I used quote to put the quoted text from the previous post in my reply and it formatted it correctly on usenet with the '>' characters in the correct place but even though I wrote my reply below the quoted text on usenet it appeared above it. On the newsgroups I posts to some people can get very upset about that. Also [ QUOTE ] [ /QUOTE ] (without the spaces) appeared at the top of the post. |
Quote:
|
Can't say if it happens all the time as I have only sent one post to usenet :)
I take it from this that it doesn't support multiple quotes within a single post? |
Not only for quote, it happens for URL too.
In case of URL it appears as [ url. The url and the closing [ /url ] are missing. |
It seems it depends on exactly what order the vb code appears in the message. It's not very easy to catch them all. Just taking the URL code as an example, I have to check for [ URL ], [ URL =.... ], [ URL ="..... ] etc. And then there is the problem of posts that embed the url by doing a please click HERE type thing. I either replace the HERE with the underlying url which may make the sentence to appear nonsense, or I could simply strip out the URL which is probably even worse. Then there's quotes and embedded quotes, colors with the # colors without the # but with double quotes.... I could go on, but you get the picture. And if that weren't enough, you have custom bbcodes :(
Anyway, I'll re-visit the regexes that trap these and see what I can do. The safest solution, however, is to turn vbcode off for usenet forums. |
I actually tried turning off vB code for the forum, then it had USENET articles displayed as [ URL ] url goes here [ /URL ].
So I quickly turned it back on. Thanks for looking into it. |
Quote:
Not to worry, I'll at least sort out the URL, QUOTE and standard bbcode problems in the next release. Simple custom bbcodes with no parameters are easy to trap for aswell. It's just the custom codes with multiple params that will be virtually impossible to fix. |
Could you please tell me when I can expect the next release? Thanks.
|
Quote:
Once all these little niggly bugs are fixed I'm going to slow down for a bit. I've also got to spend some time re-doing my sites when vb 2.0 is released. But don't worry, I've still got plenty of features planned for this hack like support for binary groups and email to PM gateway so I'm not going to give up on it. Besides, I need it for my own sites. |
It's working great at the moment but I'll tell you how I would like to see it work, for you to consider in later versions.
The thing which concerns me at the moment is the way that the posts are appearing on usenet, namely the fact that they only appear in reply to the first post, this being a restriction of having a linear board. However how I'd like it to work is to create a seperate template set for use in the newsgroup forums, in this the "Post Reply" button will be completely removed. Instead underneath each individual post I would put a link "Reply to this post", as far as the forum goes this would do exactly the same thing as Quote does (thus forcing people to quote the text). However when the posts are sent out to usenet the posts appear threaded in the correct way with the posts appearing in their correct positions in the threads. |
I think I can do this relatively easily. It would mean a vB code edit in newreply.php and, as you mentioned, a complete new template set. Although it will still work without templates and would depend on whether you clicked the 'Reply' or the 'Quote' button.
I agree that it would be better this way. In fact I seriously considered switching to wwwThreads and write the hack for that board instead. It allows each site visitor to switch between in-line and threaded view. That way you could see the usenet posts in a threaded format too. The thing that stopped me was the lack flexible custom templates via templates. Anyway, I'll see if I can get it working this weekend. I'll make it a global control panel option. |
Hi,
On the web server I use there are limits on the resource usage. Because of these my cron job that runs newnews.pl is getting killed quite often. My questions are: 1. When the job gets killed in the middle, would that leave either the newsgroups data or the forums data in any inconsistent state? 2. Can you modify the script to rotate through the newsgroups, so whatever newsgroup that is currently being fetched first would be fetched last in the next run. Or better yet give the option to do few newsgroups everytime. On my web server the following are the resouce limits: Size of Core Files - 0 MB CPU Time Used - 30 seconds Data Size - 3 MB File Size Created - 1 MB Memory Locked - 1 MB Number of Open Files - 32 Number of Simultaneous Processes - 8 I appreciate your help (and the hack :-) ) |
Does the news server need to be connected / disconnected for fetching data from every newsgroup? Can the same connection be reused for all the newsgroups currently being processed?
Please read the above question in light of resource usage problems I am having. |
Quote:
It may be too difficult to get the script to remember where the it died on the previous run and adjust the order accordingly, but adding an option to limit the number of groups may be doable. However, the option is already there (sort of). All you need to do is adjust the batch size option. This was why the option was included. By usung this method, you can guarantee that at least some messages will be pulled from each group and that all outgoing messages will be processed. |
Yes, I had the multiple servers option, while disabled the script runs much faster. Thank you.
|
Okay, I've searched thru most of the posts on this great hack, but I may have skipped over, or it just isn't there.
I'm not a technical expert, but would like to think I can tackle this task. Has anyone implemented this on a Win32 system, and if so, did you use the Active Perl install? Does the ActivePerl install have all of the needed mods required for this? Lastly, do I have to install an ISAPI filter thru the IIS MMC, 'cuz right now all I see is the PHP filter listed there. Thanks, and don't laugh too hard. :) |
Quote:
The short answer is, it might work. The latest Active state ports provide just about all the Unix functions (even fork) so there shouldn't be any problems there. The only thing I know of that Windows doesn't support is the ALRM system calls. I haven't used that so it doesn't matter. However, you may have problems with some of the modules that are required for the script to run. I know for a fact that Active State doesn't provide binaries for all of them. If you have MSVC 5 or higher you should be able to compile all the modules just as you do for a Unix installation. You just substitute 'make' with 'nmake'. Good luck and let me know if you have any success :) PS. I know nuffink about the PHP/ISAPI stuff so you're on you own there :) |
replies to a post not working..
i see the first post from usenet but the child replies do not seem to be posted on usenet.. -.-;; |
Quote:
You started a thread locally, then you replied to it a couple of times, also locally. Then you ran the script once and only once. Run it again. The replies can only be sent when it's known what the message id is of the post it's replying to. As the thread starter hadn't been sent to usenet it doesn't have a message id. |
Just a quick update on how the next release is going for those interested.
I've managed to get it working so that you can reply to individual posts within a thread and have it show up correctly threaded on usenet. It requires one single code edit in newreply.php and a hidden input field in the newreply template. I've also fixed the stripping of bbcode problems... I think. The only way to really test it is over time. There were also a few other little things that I fixed including SNA's request for a workaround for his CNEWS set up. I need a bit longer to test it but I'll be putting up a new version of dBforums.com tomorrow with a complete new set of templates for the usenet forums to better accomodate usenet posts. If you want anything else (anything easy) included in the next release speak now or forever hold your peace :) |
Quote:
I'm still running the old hack 1.8 on RC3 since my database is no longer compatible with the last hack. Couldn't figure which fields I didn't revert/update. Looking forward to the update! |
Quote:
|
| All times are GMT. The time now is 06:14 PM. |
Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.
| X vBulletin 3.8.12 by vBS Debug Information | |
|---|---|
|
|
 More Information |
|
|
Template Usage:
Phrase Groups Available:
|
Included Files:
Hooks Called:
|