vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vBulletin 3.0 Full Releases (https://vborg.vbsupport.ru/forumdisplay.php?f=33)
-   -   NNTP Gateway for Usenet ( Newsgroups ), Mailing Lists (https://vborg.vbsupport.ru/showthread.php?t=65152)

lierduh 05-20-2004 12:15 AM

Quote:

Originally Posted by Sanjiyan
Also which file do I need to download? the nntp_gateway_v2.0.zip or vb3_NNTP_Gateway_May16b.zip

The May16 release is a barebone release without the AdminCP and lack of couple of other functions.

The v2.0.1 is the full release with all the bells and wristles.:) I leave the May16 release in there just in case the new version breaks somehow. The May16 has been stable (...well, for 3 days now:)). So you should use the new one unless something is broken.

yabba 05-20-2004 12:29 AM

My gateway.php give this back from the newsserver :

Quote:

1 group(s) gatewayed.

Connecting to server, server says: 200 feed.news.schlund.de InterNetNews NNRP server INN 2.3.5 ready (posting ok).

Info for rec.music.industrial at news.puretec.de:
411 No such group rec.music.industrial
:-( But the newsserver have this group, why found the gateway.php not such group ?

Greets yabba

Erwin 05-20-2004 12:53 AM

Just let us know when you update the gateway.php file - I am using the one that you posted when you started this thread.

lierduh 05-20-2004 01:16 AM

Quote:

Originally Posted by Erwin
Just let us know when you update the gateway.php file - I am using the one that you posted when you started this thread.

The v2.0.1 contains the new gateway.php version.

lierduh 05-20-2004 01:19 AM

Quote:

Originally Posted by yabba
My gateway.php give this back from the newsserver :



:-( But the newsserver have this group, why found the gateway.php not such group ?

Greets yabba

Unless you made a typo for the newsgroup name, it should have nothing to do with gateway.php. :)

Try the fault finding method described in here:

https://vborg.vbsupport.ru/showpost....30&postcount=3

Send the result to your web host, politely ask them why you can not access that group from your web server.

mcncyo 05-20-2004 01:49 AM

i would also like the pop3 accont to work incomming and outgoing. I would like to put a few mailing list on my message board.

KevinM 05-20-2004 05:57 AM

The POP3 function on the VB2 version is something I used, but it was really picky about the type of POP3 email account used, and from memory nobody could work out what caused it. It was a a case of trying different POP3 account suppliers until finding one that worked.

Actually, I would appreciate a POP3 recommendation that works with this hack. My BT account has just been taken over by Yahoo and no longer works and all my oneandone accounts (who do all my hosting) also don't work.

Imhotep 05-20-2004 11:59 AM

IMHO, it would be cool if we could add variables for incoming and outgoing ports. My host allows incoming on port 119 but not outgoing. So, with my new NSP, I am experimenting with getting posts to get out to Usenet.

Giganews allows connections to ports 119,80, and 23

Am I to assume that I can search the PHP files for "119" and change them to whatever I want? This is what I have done for my first test.... changing all instances of 119 to 80. So far, no luck. I hope my host did not block ALL outgoing NNTP data. :ermm: I still have 23 left to test.

KevinM 05-20-2004 03:20 PM

I am getting this error whenever it hits a message with an attachment (with the latest script)

Quote:

<b>Warning</b>: fopen("/tmp/temp.bin", "x+") - Invalid argument in <b>/home/httpd/vhosts/ukgardenforum.co.uk/httpdocs/gateway.php</b> on line <b>970</b><br />
failed create a temp file
Is this related to creating the thumbnail?

Odoin 05-20-2004 10:28 PM

I have two newsgroup feeds setup... seems to be one of the forum pulls the posts made to it back into the topic so there is double posts.. one from the local user and the same post over acting as if it was from a outside user... Any idea why it would do this on just one forum?

lierduh 05-20-2004 10:37 PM

Quote:

Originally Posted by Odoin
I have two newsgroup feeds setup... seems to be one of the forum pulls the posts made to it back into the topic so there is double posts.. one from the local user and the same post over acting as if it was from a outside user... Any idea why it would do this on just one forum?

Have you changed "useragent" or organization? The latest version checks both useragent and organization in the header. The message only get imported if they do not match at the same time.

Otherwise do you have special charactors in the organization setting?

lierduh 05-20-2004 10:37 PM

Quote:

Originally Posted by KevinM
I am getting this error whenever it hits a message with an attachment (with the latest script)



Is this related to creating the thumbnail?

I will come up with a solution very soon.

lierduh 05-20-2004 10:44 PM

Quote:

Originally Posted by Imhotep
IMHO, it would be cool if we could add variables for incoming and outgoing ports. My host allows incoming on port 119 but not outgoing. So, with my new NSP, I am experimenting with getting posts to get out to Usenet.

Giganews allows connections to ports 119,80, and 23

Am I to assume that I can search the PHP files for "119" and change them to whatever I want? This is what I have done for my first test.... changing all instances of 119 to 80. So far, no luck. I hope my host did not block ALL outgoing NNTP data. :ermm: I still have 23 left to test.

The best way is to use the telnet method I described in the first page to find out exactly what is the problem.

As I mentioned before, if you can recieve the message, but not post. It mean the 119 port is OPEN! It means your web server can connect to the news server on port 119 using a high port on the web server.

What the host support might try to say to you if the guy really knows what he is talking about is. The 119 port is not open on your web server to let other people connect to it as a news server. That is, other people using a high port to connect to port 119 on your web server. This more likely is disabled!

For a TCP/IP to connect.

server port:119 <========> client port : high port (above 1024)

Also post some screen dump or test result always helps others to help you.

Imhotep 05-20-2004 11:21 PM

Quote:

As I mentioned before, if you can recieve the message, but not post. It mean the 119 port is OPEN!
Agreed, but open one way only! Have you ever heard the term "firewall"? Like I said before, my host has blocked outgoing on port 119. They could care less about incoming. They block outgoing and cite "ongoing usenet abuses" as their excuse. Port blocking is a two lane road. You have incoming and outgoing. Just because I can receive posts does not mean it's open both ways. I hope I don't have to explain this again. :ermm:

And, since I did not get an aswer to my questions, but rather a misguided and thinly-veild scolding, I will have to email my host instead and see if they have a global block on all outgoing NNTP.

SERVER <====NNTP INCOMING====< NSP
SERVER >====NNTP BLOCKED?====> NSP

lierduh 05-20-2004 11:48 PM

Quote:

Originally Posted by Imhotep
Agreed, but open one way only! Have you ever heard the term "firewall"? Like I said before, my host has blocked outgoing on port 119. They could care less about incoming. They block outgoing and cite "ongoing usenet abuses" as their excuse. Port blocking is a two lane road. You have incoming and outgoing. Just because I can receive posts does not mean it's open both ways. I hope I don't have to explain this again. :ermm:

And, since I did not get an aswer to my questions, but rather a misguided and thinly-veild scolding, I will have to email my host instead and see if they have a global block on all outgoing NNTP.

SERVER <====NNTP INCOMING====< NSP
SERVER >====NNTP BLOCKED?====> NSP

It seems you understand about firewall and TCP/IP, please explain what port is blocked and what is open, be it UDP or TCP protocol. How about an iptable/ipchain rule table for the firewall?

You receive and post news on the same port! I like to see the result of the telnet session from your web server to the nntp server's port 119. Do you know you can post news in the same session.

Now if they filter your tcp contents, then it is a different story, nothing to do with port blocking.

I am here trying to help you, you do not seems to understand my intention, rather, you think I gave you misguided information just for the fun of it. I shall not bother.

Odoin 05-21-2004 12:20 AM

No nothing has changed since the forum was first setup. It only double posts in one of the forums... the other one has no problem. I went as far as to remove the forum and newsgroup but it still did it... I am going to try a few other groups and see what comes up.


Quote:

Originally Posted by lierduh
Have you changed "useragent" or organization? The latest version checks both useragent and organization in the header. The message only get imported if they do not match at the same time.

Otherwise do you have special charactors in the organization setting?


lierduh 05-21-2004 12:23 AM

Quote:

Originally Posted by Odoin
No nothing has changed since the forum was first setup. It only double posts in one of the forums... the other one has no problem. I went as far as to remove the forum and newsgroup but it still did it... I am going to try a few other groups and see what comes up.

Can you get the full header for one of the messages in that group?

recumbent615 05-21-2004 12:49 AM

Quote:

Originally Posted by Sanjiyan
Not trying to be big headed here, but the reason this option was put into the Gilby hack, was mainly because I asked it to be, I think to date no one else uses that function in the hack bar me, but it is a very nice function to have.

Anyway, can not wait for you to get this option working again, THEN I will upgrade my boards.

I would have to disagree with you on this, I have been using this hack for quite some time under Vb2.x and use it only for the import of mailing lists. I've also used to to grab the archrive of the mailing lists from news groups that have done the archival. The one thing that is keeping me at VB2.x has been this ability...

Thanks for bringing this up to rev ...


Kevin

Imhotep 05-21-2004 01:34 AM

Quote:

Originally Posted by lierduh
It seems you understand about firewall and TCP/IP, please explain what port is blocked and what is open, be it UDP or TCP protocol. How about an iptable/ipchain rule table for the firewall?

You receive and post news on the same port! I like to see the result of the telnet session from your web server to the nntp server's port 119. Do you know you can post news in the same session.

Now if they filter your tcp contents, then it is a different story, nothing to do with port blocking.

I am here trying to help you, you do not seems to understand my intention, rather, you think I gave you misguided information just for the fun of it. I shall not bother.

From Lunarpages FAQ...

Quote:

Do you support ssh / telnet access?

NO

Although the c-panel has an ssh/telnet section, it is disabled on all of our servers for security reasons.
Quote:

please explain what port is blocked and what is open, be it UDP or TCP protocol.
My host has informed me that all outgoing traffic, be it UDP or TCP, on port 119 is blocked.

Quote:

How about an iptable/ipchain rule table for the firewall?
What about it? Do I look like I am wearing the sysop hat? Do you really think they're going to setup special rules for me?

Quote:

You receive and post news on the same port!
I am acutely aware of this fact.


Quote:

I like to see the result of the telnet session from your web server to the nntp server's port 119.
see above.


Quote:

Do you know you can post news in the same session.
Again, I am aware of this fact.

Quote:

Now if they filter your tcp contents, then it is a different story, nothing to do with port blocking.
Which is why I am now wondering if they have a global filter on all outgoing NNTP packets.

Quote:

you do not seems to understand my intention, rather, you think I gave you misguided information just for the fun of it. I shall not bother.
I understand your intention completely. I also understand that you might be as stubborn as a mule. My host writes to me and tells me all outgoing on port 119 has been blocked by their firewall. You seem bent on telling me it's wide open (both ways)... simply on the premise that I am receiving Usenet posts in my forum. IMHO, this is inherently wrong.

Odoin 05-21-2004 02:45 AM

I have not changed useragent... but I have changed organization but that was when I first set it up...

I added another newsgroup and still getting double posting... however the first newsgroup does not do this...

Any ideas?

Quote:

Originally Posted by lierduh
Have you changed "useragent" or organization? The latest version checks both useragent and organization in the header. The message only get imported if they do not match at the same time.

Otherwise do you have special charactors in the organization setting?


lierduh 05-21-2004 03:26 AM

Quote:

Originally Posted by Odoin
I have not changed useragent... but I have changed organization but that was when I first set it up...

I added another newsgroup and still getting double posting... however the first newsgroup does not do this...

Any ideas?

It is possible your news server changed your organization to a default one. Please check the header of the messages posted from your forums. You should be able to check with your normal news reader, failing that, use Google.

The original script only checks the useragent. The reason I added the organization check is if two forums are using the same news server with the same useagent, then the messages posted from the fellow forums will be skipped! I can add an option to disable organization check with the next version. Weekend is coming...:) In the meantime, find:

Code:

        if ($message['user-agent'] == $settings['useragent'] AND
                $message['organization'] == $settings['organization']) {

and replace it with:

        if ($message['user-agent'] == $settings['useragent']) {


Odoin 05-21-2004 03:34 AM

Yes they change my organization to: 100ProofNews.com - Unlimited Downloads - $8.95/Month ARG....

So can I change the useragent to prevent skipping from another forum?

lierduh 05-21-2004 03:40 AM

Quote:

Originally Posted by Odoin
Yes they change my organization to: 100ProofNews.com - Unlimited Downloads - $8.95/Month ARG....

So can I change the useragent to prevent skipping from another forum?

Yes, but first you need to change the code as indicated above. Gee, I can't believe they put advertising in your message header. I am sure that is against RFC1036!

Odoin 05-21-2004 03:58 AM

That worked :)... Thank you so much for the quick replys :).

Odoin 05-21-2004 03:59 AM

One other questions... Is there a way to change the display named on the who is online to something other then showing the gateway.php file being ran from a guest with the cron runs it?

Highlander 05-21-2004 07:39 AM

Hello :)

i just installed everything (uploaded files and tried making some settings)

But everytime i insert news server:
SERVER: msnews.microsoft.com
GROUP: microsoft.public.access

..for testing and calling gateway.php he want to donwload more than 30MB of data. should i let him finish the download?

Please help just one time till i check out how it works .. what settings , wich server and wich group with wich Last Message ID should i type in the settings?

i just need a more detailed guide for the first setup .. my forum Id ist 520 but nothing is imported there even if i downlaod 30Mb of data with gateway.php .. i just abort every time cause 30Mb of data wont fit never in the sql database.

What can i do and wich group/server i can use to try it out a little bit ..

greetings
Daniel

lierduh 05-21-2004 07:54 AM

Quote:

Originally Posted by Highlander
Hello :)

But everytime i insert news server:
SERVER: msnews.microsoft.com
GROUP: microsoft.public.access

Please help just one time till i check out how it works .. what settings , wich server and wich group with wich Last Message ID should i type in the settings?
Daniel

Set Last Message ID to 73610. If there is anything, please cut and paste the screen dump.

Highlander 05-21-2004 08:23 AM

i set everything and the message id i set also .. than i called the setlastmsg.php and after it the gateway.php ..

but no messages appear and my test messages dont semms to be uploaded.. i will test just a little bit more ..

but for another try it maybe could be useful to copy your settings for testing (for ex. another news server with group)

..thx for you quick reply on this :D

Highlander 05-21-2004 08:48 AM

it is normal that hw want to downlaod with gateway,php more than 50MB ? (i aborted it after it reqached 50MB) .. <- its the buffering you described? .. i inserted the message id you gave me :)

xb_ 05-21-2004 08:54 AM

hi

I see alot of discussion about the nntp / usenet features of the hack, while i primary use it for a mailing list archive, but not without problems (unfortunatelly).

There is this one guy on the list, whos' messages don't show up (i was thinking, he uses an encoding of some sort, which isn't supported by the hack), however they appear as an empty post, including a title and author. An example email of that specific author, can be found here.

When i don't manually edit the gateway.php to include a valid userid in the posts, the messages won't show up at all on the forumdisplay. I'm not entirelly sure what or why this is happening. (could be a permission thing in vB, as guest users don't have permissions in that specific forum)

And last, it appears that i'm having alot of 0 byte attachements; It are actually the only attachements i'm getting. So something is wrong with the insertion of those, in my setup.

[edit] in the admin page, theres some routine which creates a new table, if it thinks that the original nntp_groups doesn't excist. However this routine doesn't make notice of the TABLE_PREFIX variable, so if it is set, you'll end up with an additional empty table.[/edit].


But besides the above, everything seems to work quiet alrite. Nice work so far, although i would like to see some more discussion about mailing list archive setups.

Highlander 05-21-2004 09:09 AM

whoops.. the gateway now reached 120MB download and downloading just more .. is this normally? i just entered the forelast message id (you gave me three posts before) from the group on the msserver! so it normally had to download only 2 topics there .. hmpf.. anyone know why gateway is downloading over 120MB of data and still not stopping .. ?

should i abot it now?

also posted one message and get this error:
Quote:

1 group(s) gatewayed.
Connecting to server, server says: 200 NNTP Service 6.0.3790.1146 Version: 6.0.3790.1146 Posting Allowed
Info for microsoft.public.access at msnews.microsoft.com:
211 16354 2 73633 microsoft.public.access
Posting Message 'Beta Testing' from Highlander. Result: 441 (629) Article Rejected -- Ill-formed message id '<Highlander.16lqrp@>' in field 'Message-ID:'
Posting Message 'Beta Testing' from Highlander. Result: 441 (607) Article Rejected -- The 'References:' field requires one or more values

lierduh 05-21-2004 10:11 AM

Quote:

Originally Posted by Highlander
should i abot it now?

also posted one message and get this error:

Yes, stop it.

What is your "Email address domain" "email" setting?

I am confused. You said before after you ran setlastmsg.php, you do not get any posts. Which is correct behaviour. Now you are getting 120MB download?

Please post your settings, and screen dumps. That will be better than any description. See, last post you included the error message, I know straight away need to ask what is your setting regarding "email".

lierduh 05-21-2004 10:24 AM

Quote:

Originally Posted by xb_
hi

When i don't manually edit the gateway.php to include a valid userid in the posts, the messages won't show up at all on the forumdisplay. I'm not entirelly sure what or why this is happening.
And last, it appears that i'm having alot of 0 byte attachements; It are actually the only attachements i'm getting. So something is wrong with the insertion of those, in my setup.

But besides the above, everything seems to work quiet alrite. Nice work so far, although i would like to see some more discussion about mailing list archive setups.

I will do up the mailing list function on the weekend. If possible, please post a sample raw message that you have problem with. I need the entire header, you can cut out the attachment, but leave the beginning and the end of the attachment.

lierduh 05-21-2004 10:26 AM

Quote:

Originally Posted by Odoin
One other questions... Is there a way to change the display named on the who is online to something other then showing the gateway.php file being ran from a guest with the cron runs it?

Will need to hack into the vB scripts which I am trying to avoid as much as I can. There is no harm even someone clicks on the link though with the new version.

lierduh 05-21-2004 10:29 AM

Quote:

Originally Posted by KevinM
I am getting this error whenever it hits a message with an attachment (with the latest script)

Is this related to creating the thumbnail?

What platform is your server based on? Windows? Linux?

Please email me the phpinfo() output. I will have a crack at it.

xb_ 05-21-2004 10:30 AM

I editted the above post. As for the attachements, non of the attachements are getting through.
Looking in Mysql, the filename isn't included in the attachement table, nor is the filesize and filehash. The actuall filecontents of the attachements are there.

lierduh 05-21-2004 10:34 AM

Quote:

Originally Posted by xb_
I editted the above post. As for the attachements, non of the attachements are getting through.
Looking in Mysql, the filename isn't included in the attachement table, nor is the filesize and filehash. The actuall filecontents of the attachements are there.

Did you hack the script to work with mailing list? that probably explains it.:) Because I had to fix nntp.php and mime.php. I have not checked the pop3 class file.

What I need is the raw message from one of the problem list you have. You need to get it from a normal email reader.

KevinM 05-21-2004 11:39 AM

Quote:

Originally Posted by lierduh
What platform is your server based on? Windows? Linux?

Please email me the phpinfo() output. I will have a crack at it.

I have sent a PM with the info on it (I couldn't get your email). It worked on your last version (except for the creation of the thumbnail). It is built on a redhat Linux system.

xb_ 05-21-2004 11:56 AM

The only hacks/changes i made to it, were changeing the userid into a valid/excisting userid, and added TABLE_PREFIX to the table creation/check routine.
As for the message, i have received it from someone else's mailer (even tho i signed up with a seperate account for this :D ), but i suppose it is what you requested.

Highlander 05-21-2004 12:50 PM

lierduh i can give you (if you want check for bugs) administrtation account so you can look yourself.

I added an screenshot of the settings!
Also got this error message if i post an QUICK REPLY answer to an post in one of the USENET Forums:
Quote:

1 group(s) gatewayed.
Connecting to server, server says: 200 NNTP Service 6.0.3790.1146 Version: 6.0.3790.1146 Posting Allowed
Info for microsoft.public.access at msnews.microsoft.com:
211 16354 2 73633 microsoft.public.access
Posting Message 'Beta Testing' from Highlander. Result: 441 (629) Article Rejected -- Ill-formed message id '<Highlander.16lqrp@>' in field 'Message-ID:'
Posting Message 'Beta Testing' from Highlander. Result: 441 (607) Article Rejected -- The 'References:' field requires one or more values
Sometimes i get no posts an only the message:

Quote:

Connecting to server, server says: 200 NNTP Service 6.0.3790.1146 Version: 6.0.3790.1146 Posting Allowed
Info for microsoft.public.access at msnews.microsoft.com:
211 16354 2 73633 microsoft.public.access
and somteimes its downloading and downlaoding without stoop and any point of return :D .. my posts are aaways rejected :( .. and i did alwys set the lastmessage id before i use gateway.

greetings


All times are GMT. The time now is 03:38 PM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.02046 seconds
  • Memory Usage 1,894KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)bbcode_code_printable
  • (35)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (3)pagenav_pagelink
  • (1)pagenav_pagelinkrel
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (40)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete