The Arcive of Official vBulletin Modifications Site.

About Developer · **Released**: 02-19-2002

This hack provides a gateway to any NNTP newsgroup such as those from Usenet and other newsgroup servers. Selected newsgroups are imported from your news server and post on the forum are sent out to the newsgroup. This hack was greatly inspired by fastforward's usenet gateway hack. This one is a complete rewrite of that hack written in PHP and works with vB 2.2.2.

Installation:
Installation is pretty simple. No modifications to the vB php files are needed and it simply consists of dropping in the files to your forums directory, running the SQL modifications, and modifying the newsgroup settings for your desired newsgroups. For the complete installation details, read the readme.txt file.

Here are some of the features:

Real cool vbcode to text conversion!
All posts are inserted, even if parent thread cannot be found for replies
Guests posts also get sent to the newsgroup.
Importing of attachments from the newsgroup
Poll info sent to newsgroup
Attachment link sent to newsgroup
Supports unlimited newsgroups and servers.
email notification of new replies, just like regular forum posts
Can import HTML messages and convert to limited vb code.

For control panel integration, please check out GameCrash's Graphical Interface addition.

What's not in it that was in fastforward's usenet gateway hack:

No control panel integration at the moment. (Available separately)
Does not support separate footers
Does not allow custom email address to be used via the users option
No spam control or string replacement support.
No purging or autoexpire.

There is still lots that I'd like to add to it, but this is competely functional for basic newsgroup gateway support. It is most likely not free of bugs.

If you have questions, suggestions or annoyances, please post in this thread.

vb3 support
lierduh modified this to provide support for the beta versions of vb3. When the release candidates of vb3 come out, I plan to add support for vb3 and add other features to this hack. If you have suggestions for new features, let me know.

E-mail gateway support
New in this version, you can now gateway with an email list. This will fetch emails from a POP email account and send via php's mail function to the mailing list's email address. To set up the list, in the newsgroup field, enter in the email address to send outgoing posts to. In the server field, enter in the pop3 server, and in the username and password fields enter in, you guessed it, the username and password to your pop account. Note: the email gateway capabilities has not been fully tested, so it might not work with your POP server. Also, it does not work in combo with a news<->forum gateway in the same forum (you can use either kind though in differnet forums within your forums).

lierduh · #**947** 05-13-2004, 12:09 AM

Quote:

Originally Posted by memobug

Greetings,

Can anyone confirm whether the test newsgroup list described above (here is still running? The original parameters were these:

newsgroup= webdiscuss.test
server= free.teranews.com

No, it does not work.

[root@hd root]# telnet webdiscuss.com 119
Trying 66.51.100.134...
telnet: connect to address 66.51.100.134: Connection refused
telnet: Unable to connect to remote host: Connection refused

Odoin · #**948** 05-13-2004, 12:17 AM

I get the following error when I try and run the gateway.php. Please keep in mind I am a ASP guru and PHP is all new to me... I have run this mod with VB 2 in the past with no issues.

Warning: implode(): Bad arguments. in /home/hsphere/local/home/changed/changed/forum/gateway.php on line 83

Database error in vBulletin 3.0.1:

Invalid SQL: UPDATE post AS post, thread AS thread SET isusenetpost = 1 WHERE
post.threadid = thread.threadid AND
isusenetpost = 0 AND
thread.forumid NOT IN ()
mysql error: You have an error in your SQL syntax. Check the manual that corresponds to your MySQL server version for the right syntax to use near ')' at line 4

mysql error number: 1064

Thank you for your time.

Mark

memobug · #**949** 05-13-2004, 12:19 AM

Quote:

Originally Posted by allan grossman

memobug, maybe you can try using the nntp.php that's on page 24 of this thread? It'll do extended logging and maybe we can figure out what's what.

Thanks allan for the suggestion and lierduh for the test. I really appreciate the help. It took me nearly a month of haggling to get that port opened!

I installed the debug version of nntp that allan suggests and got this

Quote:

1 group(s) gatewayed.
200 Welcome 63.247.129.11 cnt 1
480 Username/password required
Logging in to free.teranews.com, group webdiscuss.test

So I guess this is consistent with what lierduh reports in his trial. Is there another mail server to try before I subscribe to a news service or do my results suggest I am getting far enough along for a reasonable chance of success?

Any recommendation on which news service I should go with when I subscribe? I'm looking to bring in rec.arts.bonsai , which is a text-based service. My three main requirements are cheap, cheap and you-guessed-it.

The email mod built into gateway - for posting - seemed to be generating errors on my server, so I commented it out as recommended in another post here.

Regards,

Matt

lierduh · #**950** 05-13-2004, 12:33 AM

Quote:

Originally Posted by Odoin

I get the following error when I try and run the gateway.php. Please keep in mind I am a ASP guru and PHP is all new to me... I have run this mod with VB 2 in the past with no issues.

Warning: implode(): Bad arguments. in /home/hsphere/local/home/changed/changed/forum/gateway.php on line 83

Database error in vBulletin 3.0.1:

Invalid SQL: UPDATE post AS post, thread AS thread SET isusenetpost = 1 WHERE
post.threadid = thread.threadid AND
isusenetpost = 0 AND
thread.forumid NOT IN ()
mysql error: You have an error in your SQL syntax. Check the manual that corresponds to your MySQL server version for the right syntax to use near ')' at line 4

mysql error number: 1064

Thank you for your time.

Mark

Mark, it will be easier since you are a programmer.

The error is in

"thread.forumid NOT IN ()"
where it should be "thread.forumid NOT IN (100,101,102,103)

The numbers are the forum IDs.

The following code is used to retrieve the forum ID for those usenet forums

PHP Code:


			
$get_groups=$DB_site->query("SELECT * FROM " . TABLE_PREFIX . "nntp_groups

                                WHERE enabled=1");



/*Set the tag for the non-usenet posts to speed up the query later on,

  first build a string containing all the usenet forum IDs */

while ($nntp_grp = $DB_site->fetch_array($get_groups)) {

        $forum_ids[]=$nntp_grp['forum'];

}

$forum_id_str = implode(',', $forum_ids);

Looks like the above query did not return anything.

Is there any of the nntp_groups has "enabled" set to 1 instead of 0?

hubba · #**951** 05-13-2004, 01:15 AM

>themes

Boy ME and my english

sorry. I mean THREADS... I have the "total new threads since last visit" and "total new postings since last visit" link in the forum. Excluded the NG Forums, that works fine, they dont show up if one searches for new postings, but the NG posts still COUNT. So, i.e. no "real" new posts in the forum, but 3 new in the NG forum = "3 new postins since last visit". I just wanna make a "Totalposts" = xxx - NGposts = realposts.

memobug · #**952** 05-13-2004, 01:21 AM

Quote:

Originally Posted by memobug

Thanks allan for the suggestion and lierduh for the test. I really appreciate the help. It took me nearly a month of haggling to get that port opened!

I installed the debug version of nntp that allan suggests and got this

So I guess this is consistent with what lierduh reports in his trial. Is there another mail server to try before I subscribe to a news service or do my results suggest I am getting far enough along for a reasonable chance of success?

Any recommendation on which news service I should go with when I subscribe? I'm looking to bring in rec.arts.bonsai , which is a text-based service. My three main requirements are cheap, cheap and you-guessed-it.

The email mod built into gateway - for posting - seemed to be generating errors on my server, so I commented it out as recommended in another post here.

Regards,

Matt

Hmmm. I applied for one of those $2.95, five-day Newsranger evaluations and tried to pull in posts from rec.arts.bonsai for the past couple of days.

I got this message:

Quote:

1 group(s) gatewayed.
502 news: Transfer permission denied to (my ISP's machine's numerical IP appeared here)
Logging in to www.newsranger.com, group rec.arts.bonsai

UPDATE: this problem was corrected by using client.newsranger.com instead of www.newsranger.com so things are looking good now!
Regards,

Matt

memobug · #**953** 05-13-2004, 06:02 AM

Things are looking good now, but I have a question pertaining to follow-up gateway.php synchronization. I want to be careful not to import the same records or export them!

A) Do I run setlastmessage.php

1) ...before every gateway import
2) ...after every gateway import

and

B) Do I run it only once or every time I run gateway?

The Readme isn't clear. It says:

Quote:

If you want to automatically set the newsgroups to only import new messages, upload the setlastmsg.php to your vbulletin folder and run it.

Looking at the code, it appears I need to run it AFTER gateway and possibly EVERY time to keep the lastmsg counter updated.

Thanks,

Matt

lierduh · #**954** 05-13-2004, 07:06 AM

Quote:

Originally Posted by memobug

A) Do I run setlastmessage.php

Matt

That is only for people who do not want to import all the existing messages on the server. So run it once only at the installation if needed. Don't blame no posts are imported if you do decided to run. :nervous:

lierduh · #**955** 05-13-2004, 07:08 AM

Quote:

Originally Posted by hubba

>themes

Boy ME and my english

sorry. I mean THREADS... I have the "total new threads since last visit" and "total new postings since last visit" link in the forum. Excluded the NG Forums, that works fine, they dont show up if one searches for new postings, but the NG posts still COUNT. So, i.e. no "real" new posts in the forum, but 3 new in the NG forum = "3 new postins since last visit". I just wanna make a "Totalposts" = xxx - NGposts = realposts.

Sorry, we are running different vBulletin.

:surprised: I don't have these links.

hubba · #**956** 05-13-2004, 02:23 PM

>different

Maybe

I mean the $newposts[count] und $activethreads[count] variables. They count ALL including the NG posts. The exclude statement only shows them not up, but counts it....

himerus · #**957** 05-13-2004, 05:52 PM

Lierduh,

There is a BIG error in your code in function sendnews.

PHP Code:


			
if (!$isreply){

   $DB_site->query("UPDATE " . TABLE_PREFIX . "thread 

     SET msgid = '<".addslashes($msgid).">', 

     prefix = '".$prefix[$newthread['forumid']]."'");

}

There is No WHERE clause in the query.

After using this, EVERY thread in my DB has been updated with the new msgid from the latest new thread created in the newsgroup forums.

Any way to fix this? By fixing this, I mean, resetting all the msgid's to the correct ones, or removing values where they don't belong in the thread table?

himerus · #**958** 05-13-2004, 05:56 PM

Corrected code:

PHP Code:


			
if (!$isreply){

   $DB_site->query("UPDATE " . TABLE_PREFIX . "thread 

     SET msgid = '<".addslashes($msgid).">', 

     prefix = '".$prefix[$newthread['forumid']]."'

     WHERE threadid={$newthread['threadid']}");

}

If you've got any suggestions on a quick script to repair those corrupted fields, I would be greatly appreciative. I'm not sure what effect this error, and now having a incorrect msgid on EVERY thread in the DB might or might not cause. I'm not even sure what effect that field has in general to future postings. Could I just reset all those values to empty?

allan grossman · #**959** 05-13-2004, 07:31 PM

Got a little trouble here too, lierduh

Code:

Database error in vBulletin 3.0.1:

Invalid SQL: UPDATE post AS post, thread AS thread SET isusenetpost = 1 WHERE 
	post.threadid = thread.threadid AND 
	isusenetpost = 0 AND
	thread.forumid NOT IN (25,27,29,34)
mysql error: You have an error in your SQL syntax near 'AS post, thread AS thread SET isusenetpost = 1 WHERE 
	post.threadid = thread.th' at line 1

mysql error number: 1064

Date: Thursday 13th of May 2004 04:24:04 PM

Any thoughts?

himerus · #**960** 05-13-2004, 08:54 PM

Mine's also not assigning posts to the proper thread after this change. I'm going to look over the code again for another hour or so, and revert to my last version if I can't get it working properly.

Messed up part is, the posting via the vB adminCP scheduled tasks worked after only minimal tweaking of the new script, and I have it tested to successfully post properly. (which was my only problem before)

I think the main problem is coming from the references. They don't seem to be assigning at all anymore.

lierduh · #**961** 05-13-2004, 09:13 PM

No need to worry, although thank you very much for pointing out.

the msgid in the thread table is not actually used. So it does not cause any problem at all. You can safely comment this section out. I have got a new version ready to be uploaded including an optional "X-No-Archive" header honouring. Allan will love this.

I am thinking of getting rid of this field altogether. Saving a field or index is always a good thing.

(by the way, the error is inherited from the original script

)

Quote:

Originally Posted by himerus

Lierduh,

PHP Code:


			
if (!$isreply){

   $DB_site->query("UPDATE " . TABLE_PREFIX . "thread 

     SET msgid = '<".addslashes($msgid).">', 

     prefix = '".$prefix[$newthread['forumid']]."'");

}

X vBulletin 3.8.12 by vBS Debug Information
Page Generation 0.05751 seconds Memory Usage 2,387KB Queries Executed 30 (?)
More Information
Template Usage: (1)SHOWTHREAD (1)ad_footer_end (1)ad_footer_start (1)ad_header_end (1)ad_header_logo (1)ad_navbar_below (1)ad_showthread_beforeqr (1)bbcode_code (4)bbcode_php (10)bbcode_quote (1)footer (1)forumjump (1)forumrules (1)gobutton (1)header (1)headinclude (1)modsystem_post (1)navbar (6)navbar_link (120)option (1)pagenav (1)pagenav_curpage (4)pagenav_pagelink (2)pagenav_pagelinkrel (16)post_thanks_box (16)post_thanks_button (1)post_thanks_javascript (1)post_thanks_navbar_search (16)post_thanks_postbit_info (15)postbit (16)postbit_onlinestatus (16)postbit_wrapper (1)spacer_close (1)spacer_open (1)tagbit_wrapper Phrase Groups Available: global inlinemod postbit posting reputationlevel showthread	Included Files: ./showthread.php ./global.php ./includes/init.php ./includes/class_core.php ./includes/config.php ./includes/functions.php ./includes/class_hook.php ./includes/modsystem_functions.php ./includes/functions_bigthree.php ./includes/class_postbit.php ./includes/class_bbcode.php ./includes/functions_reputation.php ./includes/functions_post_thanks.php Hooks Called: init_startup init_startup_session_setup_start init_startup_session_setup_complete cache_permissions fetch_threadinfo_query fetch_threadinfo fetch_foruminfo style_fetch cache_templates global_start parse_templates global_setup_complete showthread_start showthread_getinfo forumjump showthread_post_start showthread_query_postids showthread_query bbcode_fetch_tags bbcode_create showthread_postbit_create postbit_factory postbit_display_start post_thanks_function_post_thanks_off_start post_thanks_function_post_thanks_off_end post_thanks_function_fetch_thanks_start post_thanks_function_fetch_thanks_end post_thanks_function_thanked_already_start post_thanks_function_thanked_already_end fetch_musername postbit_imicons bbcode_parse_start bbcode_parse_complete_precache bbcode_parse_complete postbit_display_complete post_thanks_function_can_thank_this_post_start pagenav_page pagenav_complete tag_fetchbit_complete forumrules navbits navbits_complete showthread_complete
Messages:

The Arcive of Official vBulletin Modifications Site.

It is not a VB3 engine, just a parsed copy!