Go Back   vb.org Archive > vBulletin Modifications > Archive > vB.org Archives > vBulletin 2.x > vBulletin 2.x Full Releases
FAQ Community Calendar Today's Posts Search

Reply
 
Thread Tools
Details »»

Version: , by fastforward fastforward is offline
Developer Last Online: Nov 2011 Show Printable Version Email this Page

Version: 2.2.x Rating:
Released: 07-11-2001 Last Update: Never Installs: 25
 
No support by the author.

Description:

This hack provides a gateway to selected usenet groups. The entire usenet group is mirrored locally. Posts submitted locally to mirrored newsgroups will also be sent out to usenet. A single perl script is executed via cron that collects news and posts any outgoing articles. Incoming messages are parsed against customizable spam filters and threaded correctly before being placed in your forums. By default, no personal information is sent to usenet other than the posters username and whatever you have globally configured as a footer and organization. The option does exist for a user to include a custom email to use for usenet posts. After initial installation (which involves creating some new tables, adding a few columns to existing vB tables, and entering the database connection information to the news script) configuration is completed via the vB control panel.
  • See it in action at dBforums.com (usenet forums are at the bottom)
  • Download latest version for vB 2.2.4

Current version is 20020323 for vB2.xx

Current feature list:
  • correct threading of outgoing posts on usenet
  • full control panel integration
  • email notification to usenet replies
  • emoticon translation into vb icons
  • vb code removal or conversion prior to posting to usenet
  • hyperlinked urls in messages
  • color coded, italicized & indented quotes
  • vB style quote to usenet style quote conversions for outgoing posts
  • logging of outgoing posts
  • support for multiple news servers
  • support for seperate footers per forum in outgoing posts
  • multi-language (selectable) handling of quoted MIME printable headers (for all those funny foreign characters)
  • handling of mailing archive groups
  • flexible spam control and replacement variable options for incoming and outgoing messages
  • configurable auto-expire option
  • option for users to show email address in their outgoing usenet posts (may be different than normal one in profile
  • option to enable/disable user signatures on outgoing posts.
  • fully compatible with vB moderation functions
Still to be done:
  • canceling of messages after they have been sent to usenet via control message in accordance with RFC1036.
  • binary attachment support
  • email to PM gateway
Screeshots:
Main Options
More Options
Configuration of Newsgroups
Add New Newsgroups
Spam Control
What an imported usenet article looks like in vB

The latest version of this hack will always be in this first post of the thread.

Before asking questions in this thread, please read all the posts in this thread. If your question goes unanswered, it will probably be because the question has already been answered countless times in this thread.

This hack was created for use on my forums and will only be supported as time permits.


Links to required Perl Modules

Show Your Support

  • This modification may not be copied, reproduced or published elsewhere without author's permission.

Comments
  #2  
Old 07-12-2001, 09:29 AM
george_proost george_proost is offline
 
Join Date: Nov 2001
Posts: 69
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Little Problem with SEARCH.PHP

The new code for ...newusenet search does not seem to work.

I get redirected to the standard search instead of displaying the no results forund.

Any help appreciated ... I'm still looking


==========================================
Reply With Quote
  #3  
Old 07-12-2001, 01:18 PM
orca's Avatar
orca orca is offline
 
Join Date: Oct 2001
Location: Switzerland
Posts: 183
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Great work. Installation went very smoothly. Binary attachments aren't that important for me. I'm still playing abit around.
A great feature would be, that Usenet posters would be given the title Usenet guest or so automatically.
Reply With Quote
  #4  
Old 07-12-2001, 06:05 PM
george_proost george_proost is offline
 
Join Date: Nov 2001
Posts: 69
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

I seem to be having some trouble. I have upgraded as per the instructions. I seem to be loading quite a bit of data, but no population of the threads is observed. (sometimes... 1 or 2 pop up )

I also restarted from scratch some loads and after a while I get the following :

Code:
sh-2.04$ perl www/admin/newnews.pl
Connecting to news.newzpig.com... Connected
Sending authentication info... Authenticated and logged in
Processing outgoing posts
Getting article batch from bit.listserv.ispf-l
No new messages in bit.listserv.ispf-l
inserting new threads from bit.listserv.ispf-l
Processing outgoing posts
Processing outgoing posts
Getting article batch from bit.listserv.tsorexx
No new messages in bit.listserv.tsorexx
inserting new threads from bit.listserv.tsorexx
Processing outgoing posts
Processing outgoing posts
Getting article batch from comp.databases.ibm-db2
Fetching headers of articles 46866 to 46915... 
I 46866-46915 = 49 ( I requested 50 ) does this mean that if I request 1, nothing will happen ?
 yip request one get none
Processing headers for article 46867... 
Where is  46866 ?  Hmm leaves 48 now to process
Processing headers for article 46868... 
Processing headers for article 46869... 
Processing headers for article 46870... 
Processing headers for article 46871... 
Processing headers for article 46872... 
Processing headers for article 46873... 
Processing headers for article 46874... 
Processing headers for article 46875... 
Processing headers for article 46876... 

<snip>

Processing headers for article 46892... 
Processing headers for article 46893... 
Processing headers for article 46894... 
Processing headers for article 46895... 
Processing headers for article 46896... 
Processing headers for article 46897... 
Processing headers for article 46898... 
Processing headers for article 46899... 
Processing headers for article 46900... 
Processing headers for article 46901... 
Processing headers for article 46902... 
Processing headers for article 46903... 
Processing headers for article 46904... 
Processing headers for article 46905... 
Processing headers for article 46906... 
Processing headers for article 46907... 
Processing headers for article 46908... 
Processing headers for article 46909... 
Processing headers for article 46910... 
Processing headers for article 46911... 
Processing headers for article 46912... 
Processing headers for article 46913... 
Processing headers for article 46914... 
Processing headers for article 46915... 
Fetching article body 46867... OK 
Where is  46866 ?  Hmm leaves 48 now to process
Fetching article body 46868... OK
Fetching article body 46869... OK
Fetching article body 46870... OK
Fetching article body 46871... OK
Fetching article body 46872... OK
Fetching article body 46873... OK
Fetching article body 46874... OK
Fetching article body 46875... OK
Fetching article body 46876... OK
<snip>
Fetching article body 46901... OK
Fetching article body 46902... OK
Fetching article body 46903... OK
Fetching article body 46904... OK
Fetching article body 46905... OK
Fetching article body 46906... OK
Fetching article body 46907... OK
Fetching article body 46908... OK
Fetching article body 46909... OK
Fetching article body 46910... OK
Fetching article body 46911... OK
Fetching article body 46912... OK
Fetching article body 46913... OK
Fetching article body 46914... OK
Fetching article body 46915... OK
Processing article batch...
Requested 49 messages... 0 not available or rejected. 
I REQUESTED 50 actually records 48
inserting new threads from comp.databases.ibm-db2
Processing outgoing posts
Processing outgoing posts
Getting article batch from bit.listserv.asm370
No new messages in bit.listserv.asm370
inserting new threads from bit.listserv.asm370
Processing outgoing posts
Processing outgoing posts
Getting article batch from comp.lang.apl
No new messages in comp.lang.apl
inserting new threads from comp.lang.apl
Processing outgoing posts
Processing outgoing posts
Getting article batch from comp.lang.cobol
No new messages in comp.lang.cobol
inserting new threads from comp.lang.cobol
Processing outgoing posts
Processing outgoing posts
Getting article batch from comp.lang.fortran
No new messages in comp.lang.fortran
inserting new threads from comp.lang.fortran
Processing outgoing posts
Processing outgoing posts
Getting article batch from comp.lang.rexx
No new messages in comp.lang.rexx
inserting new threads from comp.lang.rexx
Processing outgoing posts
Processing outgoing posts
Getting article batch from comp.lang.c++.moderated
No new messages in comp.lang.c++.moderated
inserting new threads from comp.lang.c++.moderated
Processing outgoing posts
Clean disconnection from news.newzpig.com
Purging usenet articles...
Purging usenet threads older than 356 days from bit.listserv.ibm-main... OK
Purging usenet threads older than 356 days from bit.listserv.vse-l... OK
Purging usenet threads older than 356 days from bit.listserv.ispf-l... OK
Purging usenet threads older than 356 days from bit.listserv.tsorexx... OK
Purging usenet threads older than 356 days from comp.databases.ibm-db2... OK
Purging usenet threads older than 356 days from bit.listserv.asm370... OK
Purging usenet threads older than 356 days from comp.lang.apl... OK
Purging usenet threads older than 356 days from comp.lang.cobol... OK
Purging usenet threads older than 356 days from comp.lang.fortran... OK
Purging usenet threads older than 356 days from comp.lang.rexx... OK
Purging usenet threads older than 356 days from comp.lang.c++.moderated... OK
Purge completed.
Reply With Quote
  #5  
Old 07-12-2001, 08:19 PM
george_proost george_proost is offline
 
Join Date: Nov 2001
Posts: 69
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

I needed to do this to the code to be able to understand it ..
it sorts out the counting problem
(fetchlimit=1 also works)

... the console output I added '+1' text to confirm...and now reads
Fetching headers of articles 46866+1 to 46915...

I still get NO threads populated
the above '+1' issue needs to be resolved
.

Code:
post_outgoing_t($c,\$newsgroup);

my ($svrfirstmsg,$svrlastmsg,$tmp) = $c->group($newsgroup->{newsgroup});

if ($newsgroup->{lastmsg} eq 0) { 
   $newsgroup->{lastmsg} = $svrfirstmsg; }

elsif ($newsgroup->{lastmsg} > $svrlastmsg) {
   $newsgroup->{lastmsg} = $svrlastmsg; }

$batch_end = $newsgroup->{lastmsg}+$config{batch_limit};
      
if ($batch_end > $svrlastmsg) {
   $batch_end = $svrlastmsg; }

console("Getting article batch from $newsgroup->{newsgroup}\n");
      
if ($svrlastmsg > $batch_end) .......
I'm off to bed
Reply With Quote
  #6  
Old 07-12-2001, 09:07 PM
george_proost george_proost is offline
 
Join Date: Nov 2001
Posts: 69
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

+notify
Reply With Quote
  #7  
Old 07-12-2001, 09:07 PM
fastforward fastforward is offline
 
Join Date: Oct 2001
Location: NC, USA
Posts: 399
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Those message numbers are not guaranteed to be incremental. Articles are requested from the server based on the current pointer within the group. The server will return the next available message number, NOT the next sequential message number.

As far as the other problem, hold off posting reams of logs and give me a chance to get home and have a look at it.

I'd advise everyone else to wait a few hours before installing... unless it's too late
Reply With Quote
  #8  
Old 07-12-2001, 09:16 PM
fastforward fastforward is offline
 
Join Date: Oct 2001
Location: NC, USA
Posts: 399
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally posted by george_proost
+notify
What's that supposed to mean?

Also, using big red text demanding that things need resolving doesn't really motivate me to go out of may to fix this.
Reply With Quote
  #9  
Old 07-12-2001, 10:58 PM
fastforward fastforward is offline
 
Join Date: Oct 2001
Location: NC, USA
Posts: 399
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

This release fixes one major bug and suppresses the new annoying feature of the new DBD::MySQL module.

v20010713 (for 2.01)
  • Posts not getting loaded bug fix. This turned out to be just a misplacement of the next() method. The pointer was never moving to the next message because the code was placed outside the loop.
  • Suppressed DBI dup key warning messages. I upgraded my modules and noticed a whole bunch of informational warning messages start to appear whenever a duplicate key was violated. The violations are supposed to happen. The script lets MySQL do the work of checking the constaints in the word table. This is far more efficient than trying to figure it out in code (especially on large tables). The messages have been suppressed and you don't need to know about them . This is probably what some people were assuming to be errors. There was no need to worry and indexing need not have been disabled.
  • Fixed Option description in CP. The 'Suppress Usenet Posts in Stats' is back to front. Without a code change, they will be shown. With the code change, this option acts as a toggle.

If you installed v20010712 last night or today, you just need to replace the newnews.pl and run the SQL in the upgrade script to fix the control panel typo.

Download Here
Reply With Quote
  #10  
Old 07-13-2001, 03:17 AM
fastforward fastforward is offline
 
Join Date: Oct 2001
Location: NC, USA
Posts: 399
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Another couple of little bugfixes.

v20010714 (for 2.01)
  • Fix to prevent duplicates being loaded into forums
  • Fix to stop hashes being displayed in place of angled brackets around address.

If you installed v20010713 today, you just need to replace the newnews.pl.

Download Here
Reply With Quote
Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 05:37 PM.


Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2024, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.05063 seconds
  • Memory Usage 2,314KB
  • Queries Executed 23 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)ad_showthread_beforeqr
  • (2)bbcode_code
  • (1)bbcode_quote
  • (1)footer
  • (1)forumjump
  • (1)forumrules
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (1)modsystem_post
  • (1)navbar
  • (6)navbar_link
  • (120)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (2)pagenav_pagelink
  • (2)pagenav_pagelinkrel
  • (10)post_thanks_box
  • (10)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (10)post_thanks_postbit_info
  • (9)postbit
  • (10)postbit_onlinestatus
  • (10)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open
  • (1)tagbit_wrapper 

Phrase Groups Available:
  • global
  • inlinemod
  • postbit
  • posting
  • reputationlevel
  • showthread
Included Files:
  • ./showthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showthread_start
  • showthread_getinfo
  • forumjump
  • showthread_post_start
  • showthread_query_postids
  • showthread_query
  • bbcode_fetch_tags
  • bbcode_create
  • showthread_postbit_create
  • postbit_factory
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • fetch_musername
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • pagenav_page
  • pagenav_complete
  • tag_fetchbit_complete
  • forumrules
  • navbits
  • navbits_complete
  • showthread_complete