The Arcive of Official vBulletin Modifications Site.

About Developer · **Released**: 01-21-2001

THIS THREAD IS CLOSED!
Posts in here will NOT be answered

This hack has undergone many major changes since this thread was started. Consequently, most of the posts have become dated and of little use. To coincide with the latest major release (20010712), a new one has been started.

See this thread for the latest version and discussion

fastforward · #**372** 05-06-2001, 04:12 PM

Quote:

Originally posted by Mark Hewitt
I've changed to the new version and I'm not getting the errors I was getting before.

Code:

Use of uninitialized value in addition (+) at newnews.pl line 95. Use of uninitialized value in numeric gt (>) at newnews.pl line 95. Getting article batch from rec.autos.sport.f1.moderated Use of uninitialized value in numeric gt (>) at newnews.pl line 99. Use of uninitialized value in numeric gt (>) at newnews.pl line 99. No new messages in rec.autos.sport.f1.moderated inserting new threads from rec.autos.sport.f1.moderated checking for orphans... Processing outgoing posts Processing outgoing posts

You have something very wrong with your installation. Those errors are telling you it can't find the last message number from the config. Those Particular lines have not been changed since the early versions. The same goes for the date issues you were getting. The reason you don't get date errors now is because it is forced to local time if it's still NULL after trying to get the NNTP date.

I can't reproduce the errors and I've pulled countless newsgroups including rec.motorcycles.racing that was giving you problems.

Have you changed Perl versions recently? Did you do a *complete* fresh install? Is anyone else having these problems.

The only way to troubleshoot your problem would be if I had access to you machine and newserver.

Let me try anaother fresh install on another server and I'll see if I can re-produce the errors. Give me a few hours.

fastforward · #**373** 05-06-2001, 08:12 PM

OK.. Here's another one. I rechecked the entire code and errorchecking. I installed it on a fresh vB on two different servers

FreeBSD with an old version of MySQL (3.22.32) and Perl 5.005_03
Linux 6.1 with the latest MySQL (3.23.37) and Perl 5.005_03

Both installations had the latest required modules from CPAN.
Two newservers were used, onlynews.com and DNEWS. DNEWS is used by a lot of the major news providers including Supernews.

There were no errors found with either configuration on either server.

There realy isn't much else I can do. All I suggest is you make a completely fresh install, DO NOT make any code changes except the bit to add the control panel. Add the basic configuration settings, but leave most of the settings as the default. Then run the script. Change the settings and/or and add the code changes one by one if you need them and see where the errors start occuring.

Download v20010506 for RC2

#**374** 05-07-2001, 02:28 AM

Just reinstalled it... it loops after reading in the headers...

Connecting to #######... Connected
Processing outgoing posts
Getting article batch from ######
Fetching headers of articles 1 to 23...
Processing headers for article 2...
Processing headers for article 3...
Processing headers for article 4...
Processing headers for article 5...
Processing headers for article 6...
Processing headers for article 7...
Processing headers for article 8...
Processing headers for article 9...
Processing headers for article 10...
Processing headers for article 11...
Processing headers for article 12...
Processing headers for article 13...
Processing headers for article 14...
Processing headers for article 15...
Processing headers for article 16...
Processing headers for article 17...
Processing headers for article 18...
Processing headers for article 19...
Processing headers for article 20...
Processing headers for article 21...
Processing headers for article 22...
Processing headers for article 23...
Fetching article body 2... OK
Fetching article body 3... OK
Fetching article body 4... Not fetched - Spam
Fetching article body 5... OK
Fetching article body 6... OK
Fetching article body 7... OK
Fetching article body 8... OK
Fetching article body 9... OK
Fetching article body 10... OK
Fetching article body 11... OK
Fetching article body 12... OK
Fetching article body 13... OK
Fetching article body 14... OK
Fetching article body 15... OK
Fetching article body 16... OK
Fetching article body 17... OK
Fetching article body 18... OK
Fetching article body 19... OK
Fetching article body 20... OK
Fetching article body 21... OK
Fetching article body 22... Not fetched - Spam
Fetching article body 23... Not fetched - Binary post
Processing article batch...
Requested 22 messages... 3 not available or rejected.

inserting new threads from cast.testing
checking for orphans...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...
loading 1 replies...

And just keeps going....

I suggest NOT looking for the Lines: ## in the NG posts... Did you know that the posts added FROM the forum dont have a Lines: ## in the header?

Can we disable the option that looks to see if Lines: exsists...

#**375** 05-07-2001, 02:46 AM

Its fixed now.. I dumped the ref table... But now.. why doesnt the posts from the FORUMS insert a "Lines: ##" line into the header?

fastforward · #**376** 05-07-2001, 03:06 AM

Quote:

Originally posted by SNA
I suggest NOT looking for the Lines: ## in the NG posts... Did you know that the posts added FROM the forum dont have a Lines: ## in the header?

Can we disable the option that looks to see if Lines: exsists...

You can disable it if you really want to. But you may end up with huge useless posts and possibly binaries.

All posts have the 'Lines:' in the header regardless of their source. It is added by the news server along with all the other stuff that a client news reader can't be trusted to add.

As for the looping problem, have you made several runs and reset article numbers without clearing out the usenet load tables? I suggest you clear out your usenet_article, usenet_article_loader and usenet_ref tables and see if it happens again.

It will continue to loop as long as it finds articles that are ready for loading. You should see several of these 'loading replies' messages in sussession usually with decreasing numbers. It will then attempt to load the article into the forum. Whether it fails or succeeds to insert the post into the forum is irrelevant, it will be deleted from the loader table.

So there are only a few logical scenarios for this error to occur.

if the deletion failed for some reason. As you made no mention of an error message, the script may have been aborted at some point before the actual delete took place.
if the post it is trying to load actually originated from the forum in the first place and you have 'import existing posts' turned on, the article already exists in the post table and you reset the message counters to 0 at some point.
you changed the header information that identifies your site. The script has no idea that the post originated from you but it still found a postid and is trying to load it.

I will look at adding additional error checking to trap some of these.

#**377** 05-07-2001, 03:09 AM

Ok Cool...

Im using Cnews.. and it isnt adding the Lines: ## their from the posts coming off the Forums... Im guessing there is a config file somewhere to enable it...

Maybe you want to take that into condiseration...

If it doesnt find a Lines: then it should do something other consider it a binary..

Just a suggestion.. GREAT HACK

It will be used.

fastforward · #**378** 05-07-2001, 04:24 AM

Quote:

Originally posted by SNA
Ok Cool...

Im using Cnews.. and it isnt adding the Lines: ## their from the posts coming off the Forums... Im guessing there is a config file somewhere to enable it...

Maybe you want to take that into condiseration...

If it doesnt find a Lines: then it should do something other consider it a binary..

The only other way to determine if it's a binary post is by your own configurable spam filters. The obvious one to check for is 'begin 644'. This is actually added by default. The lines check is really only an additional check and a way for you limit the size of messages you want to download.

You say the server isn't adding the Lines field. As you mention, it is probably a configuration issue. What about other articles, or are you receiving a full IHAVE usenet feed? If it's just acting as a client to an upstream news server then you will probably see the Lines header on all other posts. If the issue is only with articles that are posted directly to your cnews server then there's not really a problem as when that message is propogated to another server, the field will be added.

The other point of course is why would we care if forum posts have it or not. They don't even get parsed by that code. We don't need to check them as we're not even downloading them.

#**379** 05-07-2001, 10:35 AM

OK I run my own newsgroups.. I am not a client.. I am a Server.

Lets say people post to the forums and I have to delete all the posts for some reason... when I go to download all the messages again it skips past all the ones created from the forums because there is no Lines: ## Line.

Mark Hewitt · #**380** 05-08-2001, 07:09 AM

Hey!! it works, and I didn't change anything either. Thanks fastforward for all your help. I must have got quite boring over the past couple of weeks.

Just a couple of questions on how posts appear on usenet.

I used quote to put the quoted text from the previous post in my reply and it formatted it correctly on usenet with the '>' characters in the correct place but even though I wrote my reply below the quoted text on usenet it appeared above it. On the newsgroups I posts to some people can get very upset about that.

Also
[ QUOTE ] [ /QUOTE ] (without the spaces) appeared at the top of the post.

fastforward · #**381** 05-08-2001, 11:41 AM

Quote:

Originally posted by Mark Hewitt
Hey!! it works, and I didn't change anything either. Thanks fastforward for all your help. I must have got quite boring over the past couple of weeks.

Just a couple of questions on how posts appear on usenet.

I used quote to put the quoted text from the previous post in my reply and it formatted it correctly on usenet with the '>' characters in the correct place but even though I wrote my reply below the quoted text on usenet it appeared above it. On the newsgroups I posts to some people can get very upset about that.

Also
[ QUOTE ] [ /QUOTE ] (without the spaces) appeared at the top of the post.

I re-wrote all the outgouin post bits recently to try to tidy it up. I'll add an option for you to decide whether you want the quote above or below the message. The other thing with the '[ QUOTE ]' showing must be a bug. Does it happen all the time?

X vBulletin 3.8.12 by vBS Debug Information
Page Generation 0.05180 seconds Memory Usage 2,314KB Queries Executed 25 (?)
More Information
Template Usage: (1)SHOWTHREAD (1)ad_footer_end (1)ad_footer_start (1)ad_header_end (1)ad_header_logo (1)ad_navbar_below (1)ad_showthread_beforeqr (1)bbcode_code (4)bbcode_quote (1)footer (1)forumjump (1)forumrules (1)gobutton (1)header (1)headinclude (1)modsystem_post (1)navbar (6)navbar_link (120)option (1)pagenav (1)pagenav_curpage (4)pagenav_pagelink (2)pagenav_pagelinkrel (11)post_thanks_box (11)post_thanks_button (1)post_thanks_javascript (1)post_thanks_navbar_search (11)post_thanks_postbit_info (10)postbit (6)postbit_onlinestatus (11)postbit_wrapper (1)spacer_close (1)spacer_open (1)tagbit_wrapper Phrase Groups Available: global inlinemod postbit posting reputationlevel showthread	Included Files: ./showthread.php ./global.php ./includes/init.php ./includes/class_core.php ./includes/config.php ./includes/functions.php ./includes/class_hook.php ./includes/modsystem_functions.php ./includes/functions_bigthree.php ./includes/class_postbit.php ./includes/class_bbcode.php ./includes/functions_reputation.php ./includes/functions_post_thanks.php Hooks Called: init_startup init_startup_session_setup_start init_startup_session_setup_complete cache_permissions fetch_threadinfo_query fetch_threadinfo fetch_foruminfo style_fetch cache_templates global_start parse_templates global_setup_complete showthread_start showthread_getinfo forumjump showthread_post_start showthread_query_postids showthread_query bbcode_fetch_tags bbcode_create showthread_postbit_create postbit_factory postbit_display_start post_thanks_function_post_thanks_off_start post_thanks_function_post_thanks_off_end post_thanks_function_fetch_thanks_start post_thanks_function_fetch_thanks_end post_thanks_function_thanked_already_start post_thanks_function_thanked_already_end fetch_musername bbcode_parse_start bbcode_parse_complete_precache bbcode_parse_complete postbit_display_complete post_thanks_function_can_thank_this_post_start postbit_imicons pagenav_page pagenav_complete tag_fetchbit_complete forumrules navbits navbits_complete showthread_complete
Messages:

The Arcive of Official vBulletin Modifications Site.

It is not a VB3 engine, just a parsed copy!