NNTP Gateway for Usenet ( Newsgroups ), Mailing Lists

[cyc]

Hi

I have noticed if we get the error "Could not connect to NNTP-server" the script still tries to post to the newsgroup. Would it be possible to edit the script so it doesnt try to post if it doesnt get a successful connection to the news server?

cheers

[Izze_de]

hi,

i have the problem that i set up one newsgroup in one forum for testing.

it works fine now it dont stop importing the news.
first i set the newgroup to inactive.
then i deleted the group.
then i delted the cronjob in crontab.

nothing works it is still importing like hell.
and it has still the same time. this time is hours ago.
looks like a nevernding poll of the gateway.php because the time didnt change. it is still the time when i started this the first time.

what can i do to stop this ?

thx

EDIT

all right, it seems that i found how to stop it.

i restarted apache2 webserver and now it stopped.

strange... :ermm:

[Izze_de]

I have the script up and running on a new vB3.03 install. It seems as though when I d/l posts/threads (from usenet) that my overall post/thread count statistics increment at a 2:1 ratio (the main forums view stats to the right of the individual forums seem normal though). ie, if I were to have downloaded 10k posts my overall post stats would read 20k. Why would posts / threads be double counted in the overall stats (but not on the individual stats)?

This happened both when I initially downloaded threads as well as everytime I d/l additonal posts when the cron job runs.

oh yeah, and non-usenet forums that are strictly local do correctly update the overall and forum specific post/thread count at a 1:1 ratio.

:pirate:

exactly same problem for me.
all newsgroups are counted double.
normal forum threads just once.

and this is a clear, just one testpost, user- and hackfree (except this one) forum.
brand new installed.

[Marv]

Is there another way to exclude the usenet-posts from getnew instead of changing the getnew-param to
/search.php?do=getnew&exclude=120,121,122,123,124,125,126,127,128,129,13 0,131,132,133
? We were informed by some users that they?ve encountered errorscausetheir browsers can?t handle the long version where everysingleforum-id is listed :ermm:

We import about 50 newsgroups in our forums and I would like tohavethem excluded like/search.php?do=getnew&exclude=120-140but the string"...&exclude=120-140" won?t work. Anyone who couldshow me a quick?ndirty workaround ?

Any help appreciated.

[ART]

I've been using the Usenet gateway on my vb2 forums - last sunday I did an update to vb306 at last. now i wanted to update the gateway hack too - and now I have a question - can I use this hack on existing usenet-forums within my site? Will the new hack recognize the posts and threads that are already stored on my usenet-forums and won't try to resend it to usenet groups?

[Bro_Joey_Gowdy]

I was curious as to how many different usenet newsgroup providers there were and how much they cost, so, Ive started a thread in the lounge entitled :

"What "Usenet" newsgroup provider do you use ?"

https://vborg.vbsupport.ru/showthread.php?t=75232

It would have been nice to have seen this question / link in the F.A.Q. post of this thread.

[lierduh]

I've been using the Usenet gateway on my vb2 forums - last sunday I did an update to vb306 at last. now i wanted to update the gateway hack too - and now I have a question - can I use this hack on existing usenet-forums within my site? Will the new hack recognize the posts and threads that are already stored on my usenet-forums and won't try to resend it to usenet groups?

You should be able to upgrade from v2 version automatically by opening up the two control panel pages once.

No the posts already exported will not be exported again.

[lierduh]

I was curious as to how many different usenet newsgroup providers there were and how much they cost, so, Ive started a thread in the lounge entitled :

"What "Usenet" newsgroup provider do you use ?"

https://vborg.vbsupport.ru/showthread.php?t=75232

It would have been nice to have seen this question / link in the F.A.Q. post of this thread.

Will include the link in the FAQ post. Perhaps you need to make it more clear about the usage of newsgroup provider, ie. using it with a forum gateway and link back to this thread. So that people know it is not just for private access.

[lierduh]

If you have many newsgroup forums. You can put all your local forums under one main forum. Then you can use the main forum id in the URL just as we have done for the NNTP forums.

/search.php?do=getnew&forumid=1
(1 is the main forum id for all your local forums)

Is there another way to exclude the usenet-posts from getnew instead of changing the getnew-param to
/search.php?do=getnew&exclude=120,121,122,123,124,125,126,127,128,129,13 0,131,132,133
? We were informed by some users that they?ve encountered errorscausetheir browsers can?t handle the long version where everysingleforum-id is listed :ermm:

We import about 50 newsgroups in our forums and I would like tohavethem excluded like/search.php?do=getnew&exclude=120-140but the string"...&exclude=120-140" won?t work. Anyone who couldshow me a quick?ndirty workaround ?

Any help appreciated.

[infiniterb]

lierduh,

I'm still having my issue that I posted above. I can get posts to show up on my forums, and I can successfully post. I am using the Scheduled Tasks in vb and it works fine. However, all is working fine for only the first forum in the list. I'm currently using the following groups in this order:

24hoursupport.helpdesk
alt.privacy.spyware
microsoft.public.security
microsoft.public.windows.inetexplorer.ie6.browser
microsoft.public.windowsxp.basics
microsoft.public.windowsxp.general
microsoft.public.windowsxp.help_and_support
microsoft.public.windowsxp.security_admin

All groups are enabled, and are using a personal newshosting.com account I have set up with posting access. When gateway.php runs via the scheduled tasks, it hits the first group on the list, and updates it with the new posts from the NG. I have gateway.php set to hit the groups listed above every 15 min (I've played with different times, and nothing seems to work).

Any idea why only the first group in my list will update? I've even set the first group to disabled, which allows the 2nd group to update just fine and allow posting, however the 3rd group on down are not updated. It'd be a real pain to have to enable/disable groups manually.

[lierduh]

Have you ruled out the server only lets you access one group at a time?



lierduh,

I'm still having my issue that I posted above. I can get posts to show up on my forums, and I can successfully post. I am using the Scheduled Tasks in vb and it works fine. However, all is working fine for only the first forum in the list. I'm currently using the following groups in this order:

24hoursupport.helpdesk
alt.privacy.spyware
microsoft.public.security
microsoft.public.windows.inetexplorer.ie6.browser
microsoft.public.windowsxp.basics
microsoft.public.windowsxp.general
microsoft.public.windowsxp.help_and_support
microsoft.public.windowsxp.security_admin

All groups are enabled, and are using a personal newshosting.com account I have set up with posting access. When gateway.php runs via the scheduled tasks, it hits the first group on the list, and updates it with the new posts from the NG. I have gateway.php set to hit the groups listed above every 15 min (I've played with different times, and nothing seems to work).

Any idea why only the first group in my list will update? I've even set the first group to disabled, which allows the 2nd group to update just fine and allow posting, however the 3rd group on down are not updated. It'd be a real pain to have to enable/disable groups manually.

[infiniterb]

I have not. I was wondering if anyone else had similar issues, or if this were something you had come across.

[recumbent615]

I have recently installed this mod on my upgraded VB V3.0.6 . I had been using the same mod on my old VB 2.x install. I use it as a Mailing list gateway and it is much improved over the older VB2 version.

I have noticed that it does not seem to do the right thing when it reads a message that is a reply ( to the mailing list ) to an exsisting thread that does not contain a References header. I had read in some posts that others had seen this issue last year, and I believe that KevinM had a patch. My question is, did that not work? is that why it was not incorproated into the latest released version?

I just did not want to apply a mod to the mod if it does not work?

Thanks for any feed back on this issue.

Kevin B

[ART]

You should be able to upgrade from v2 version automatically by opening up the two control panel pages once.

No the posts already exported will not be exported again.

Thanks lierduh, in the meantime I did the update - and all went smoothly :)

and thanks for the work - the new gateway runs perfect for me!

[recumbent615]

I have recently installed this mod on my upgraded VB V3.0.6 . I had been using the same mod on my old VB 2.x install. I use it as a Mailing list gateway and it is much improved over the older VB2 version.

I have noticed that it does not seem to do the right thing when it reads a message that is a reply ( to the mailing list ) to an exsisting thread that does not contain a References header. I had read in some posts that others had seen this issue last year, and I believe that KevinM had a patch. My question is, did that not work? is that why it was not incorproated into the latest released version?

I just did not want to apply a mod to the mod if it does not work?

Thanks for any feed back on this issue.

Kevin B


Here is an example of the problem: See the attached Image Issue.gif

and the headers from the Second line of that Image that did not get threaded correctly

Return-path: <exim-users-bounces+eximlist=exim-users.org@exim.org>
Envelope-to: eximlist@exim-users.org
Delivery-date: Mon, 07 Feb 2005 18:37:46 -0500
Received: from sesame.csx.cam.ac.uk ([131.111.8.41])
by hpserver.kmb.com with esmtp (Exim 4.42)
id 1CyIRs-0007Mi-Td
for eximlist@exim-users.org; Mon, 07 Feb 2005 18:37:46 -0500
Received: from [::1] (port=1855 helo=sesame.csx.cam.ac.uk)
by sesame.csx.cam.ac.uk with esmtp (Exim 4.44)
id 1CyHaK-0003hx-8O; Mon, 07 Feb 2005 22:42:24 +0000
Received: from 82-68-67-219.dsl.in-addr.zen.co.uk ([82.68.67.219]:18657
helo=openbsd.rigwam.net)
by sesame.csx.cam.ac.uk with esmtp (Exim 4.44) id 1CyHaG-0003h3-97
for exim-users@exim.org; Mon, 07 Feb 2005 22:42:21 +0000
Received: from [10.10.1.54] (helo=onion)
by openbsd.rigwam.net with esmtp (Exim 3.36 #1) id 1CyHaF-00032c-00
for exim-users@exim.org; Mon, 07 Feb 2005 22:42:19 +0000
From: "Rob Stead" <admin@robstead.co.uk>
To: <exim-users@exim.org>
Subject: RE: [exim] SMTP forwards with EXIM
Date: Mon, 7 Feb 2005 22:41:59 -0000
MIME-Version: 1.0
Content-Type: text/plain;
charset="us-ascii"
Content-Transfer-Encoding: 7bit
X-Mailer: Microsoft Office Outlook, Build 11.0.6353
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.2180
In-Reply-To: <be7b2f3f05020713231dd52103@mail.gmail.com>
Thread-Index: AcUNW18ukIiI7c5VSbWoXxZWrBT8OQACIBcg
Message-Id: <E1CyHaF-00032c-00@openbsd.rigwam.net>
X-Spam-Score: -4.9 (----)
X-BeenThere: exim-users@exim.org
X-Mailman-Version: 2.1.5
Precedence: list
Reply-To: admin@robstead.co.uk
List-Id: A user list for the exim MTA <exim-users.exim.org>
List-Unsubscribe: <http://www.exim.org/mailman/listinfo/exim-users>,
<mailto:exim-users-request@exim.org?subject=unsubscribe>
List-Archive: <http://www.exim.org/mail-archives/exim-users>
List-Post: <mailto:exim-users@exim.org>
List-Help: <mailto:exim-users-request@exim.org?subject=help>
List-Subscribe: <http://www.exim.org/mailman/listinfo/exim-users>,
<mailto:exim-users-request@exim.org?subject=subscribe>
Sender: exim-users-bounces@exim.org
Errors-To: exim-users-bounces+eximlist=exim-users.org@exim.org
X-AV-Scan: This message has been scanned by ClamAV via KMB.COM
X-Spam-KMB-Score: 0.1 : /


Note that the Subject is RE: but there is not References Tag in the header. I thought that this hack would first look for the Reference line in the header and if it could not fine one it would then try to match on Subject ( after removing the RE: )

Is it possible that there is a setting that I have missed or need to add to get this MOD to thread both ways ?

Thanks

Kevin

[recumbent615]

I beliieve that I found the answer to my Question, and Yes I was Missing a setting. Thread_by_subject was set to "0", I was under the impression that setting that would forego the use of the References header information. After reading the code some I see that this is not the case, I turned on this switch and eveything seems to work correctly. The only question I have is am I miss reading the code and setting my self up for a mess?

Thanks
Kevin

[BilldaCat]

exactly same problem for me.
all newsgroups are counted double.
normal forum threads just once.

and this is a clear, just one testpost, user- and hackfree (except this one) forum.
brand new installed.

Confirming this problem as well on my boards. Has anyone found a fix?

[infiniterb]

I have not. I was wondering if anyone else had similar issues, or if this were something you had come across.

Ok, I spoke with my host and he's saying there's nothing on their end that should prevent the gateway.php from accessing more than one group at a time. So, lierduh, I'm ruling out that my web hosts server allows only one group to be accessed at one time.

Any other ideas?

[Marv]

If you have many newsgroup forums. You can put all your local forums under one main forum. [...]

/search.php?do=getnew&forumid=1
(1 is the main forum id for all your local forums)

Thanks lierduh - that did the trick :up:

[SaN-DeeP]

1. Messages are getting imported twice.. in all forums.

2. Username appears weird in many imported messages.

(*Check attachment for more details)

Regards,
sorry for bumping again, still looking for a solution.

Regards,

[AWS]

Have you checked the newsgroup? Usenet posts when using a newsreader don't get posted right away. The poster might have posted and didn't see it appear and posted again.
I don't know what is cauing the weird username. Maybe a bug in the persons news reader.

[SaN-DeeP]

Have you checked the newsgroup? Usenet posts when using a newsreader don't get posted right away. The poster might have posted and didn't see it appear and posted again.
I don't know what is cauing the weird username. Maybe a bug in the persons news reader.
I have checked couple of times about this problem but not able to debug...
When importing from newsgroups, couple of messages gets imported twice or thrice as well the weird username problem appears while browsing those forums.

Regards,

[BilldaCat]

Confirming this problem as well on my boards. Has anyone found a fix?

bumping this again, still looking for a solution.

(posts being counted twice in total count)

[lierduh]

Confirming this problem as well on my boards. Has anyone found a fix?

Will fix this non-critical problem before next release. I need to set up a test forum to debug. In the meantime, please use the counter-reset function.

[lierduh]

Ok, I spoke with my host and he's saying there's nothing on their end that should prevent the gateway.php from accessing more than one group at a time. So, lierduh, I'm ruling out that my web hosts server allows only one group to be accessed at one time.

Any other ideas?

Have you checked with NNTP server host instead of web host?

[lierduh]

I have checked couple of times about this problem but not able to debug...
When importing from newsgroups, couple of messages gets imported twice or thrice as well the weird username problem appears while browsing those forums.

Regards,

Not sure why it gets imported twice. Have you confirmed this with a normal news reader?

Weird user name problem is caused by other language encoding in the user name. The script has ability to decode, make sure your php server has "imap_mime_header_decode" function.

[SaN-DeeP]

Not sure why it gets imported twice. Have you confirmed this with a normal news reader?

Weird user name problem is caused by other language encoding in the user name. The script has ability to decode, make sure your php server has "imap_mime_header_decode" function.
"imap_mime_header_decode" function is enabled on server.
I checked the message with normal news readers, only 1 message appears in news reader.

[Slave]

Just installed .. worked like a charm .. :)

[joeMJ]

Hello,

I installed this script as recommended. Port 119 is open and it synchronized Newsgroup (with some ISO/ encoding problems) the newsgroup in my forums. I'd like to synchronize msnews, microsoft.public.de.smartphone.

Server is Win2003, Web Edition, actual php and mysql.

Link to NG=>VB Forums is here (http://www.mobilejoe.de/joeforums/forumdisplay.php?f=57)

Problem:

I answered a post in the newsgroup (as you see here (http://www.mobilejoe.de/joeforums/showthread.php?t=9892)).
Then I manually started gateway.php

Errormessage I get, when I started gateway.php:

Datenbankfehler in vBulletin 3.0.7:

Ungueltige SQL-Abfrage:
SELECT email, field1 AS signature, usertitle, customtitle
FROM user AS user
LEFT JOIN userfield AS userfield
ON user.userid = userfield.userid
WHERE user.userid = 1

mysql error: Unknown column 'field1' in 'field list'

mysql error number: 1054

Datum: 28.02.2005 13:07:43
Skript: http://www.mobilejoe.de/joeforums/gateway.php
Referer:
Benutzername: joe
IP-Adresse: 217.84.8.114

debug=1:

Gateway version 2.3.2 1 group(s) gatewayed.

Connecting to server, server says: 200 NNTP Service 6.0.3790.206 Version: 6.0.3790.206 Posting Allowed

Info for microsoft.public.de.smartphone at msnews.microsoft.com: 211 137 1040 1212 microsoft.public.de.smartphone

<html><head><title>mobilejoe.de Datenbankfehler</title><style type="text/css"><!--.error { font: 11px tahoma, verdana, arial, sans-serif; }--></style></head>
<body></table></td></tr></table></form>
<blockquote><p class="error">&nbsp;</p><p class="error"><b>Es trat ein Problem mit der mobilejoe.de Datenbank auf.</b><br />
Bitte versuchen Sie es erneut, indem Sie die Seite neu laden (<a href="javascript:window.location=window.location;">Aktualisieren, Refresh, Reload</a> usw. im Browser klicken).</p><p class="error">Eine E-Mail wurde an den <a href="mailto:joe@mobilejoe.de">Technischen Administrator</a> geschickt, den Sie ebenfalls kontaktieren k?nnen, falls das Problem weiterhin auftritt.</p><p class="error">Wir entschuldigen uns f?r die Unannehmlichkeiten.</p><form><textarea class="error" rows="15" cols="100" wrap="off">Datenbankfehler in vBulletin 3.0.7:

Ungueltige SQL-Abfrage:
SELECT email, field1 AS signature, usertitle, customtitle
FROM user AS user
LEFT JOIN userfield AS userfield
ON user.userid = userfield.userid
WHERE user.userid = 1

mysql error: Unknown column 'field1' in 'field list'

mysql error number: 1054

Datum: 28.02.2005 14:55:25
Skript: http://www.mobilejoe.de/joeforums/gateway.php?debug=1
Referer:
Benutzername: joe
IP-Adresse: 217.84.8.114
</textarea></form></blockquote>

</body></html>

(screenshot below)

Can please anyone help me in that problem?


Thank you very much!
cheers
joe

[lierduh]

Hello,
Datenbankfehler in vBulletin 3.0.7:

Ungueltige SQL-Abfrage:
SELECT email, field1 AS signature, usertitle, customtitle
FROM user AS user
LEFT JOIN userfield AS userfield
ON user.userid = userfield.userid
WHERE user.userid = 1

mysql error: Unknown column 'field1' in 'field list'

mysql error number: 1054

Datum: 28.02.2005 13:07:43
Skript: http://www.mobilejoe.de/joeforums/gateway.php
Referer:
Benutzername: joe
IP-Adresse: 217.84.8.114
joe

Basically it says 'field1' field is not presented in your 'userfield' table. I can't explain why you don't. You can check whether you have 'userfield' table, and is there 'field1' in this table. 'field1' stores the signature of the users. Failing that, you can alway turn off the signature in the settings, or in the post interface.

[joeMJ]

Ah oops. As I queried phpMyadmin, I don't have this field - I got 2,3,8 and 9, where 2 is city and so on. I disabled Signature in NNTP Settings Menu, but no success - I still get

Datenbankfehler in vBulletin 3.0.7:

Ungueltige SQL-Abfrage:
SELECT email, field1 AS signature, usertitle, customtitle
FROM user AS user
LEFT JOIN userfield AS userfield
ON user.userid = userfield.userid
WHERE user.userid = 1

mysql error: Unknown column 'field1' in 'field list'

mysql error number: 1054

Datum: 28.02.2005 22:26:20
Skript: http://www.mobilejoe.de/joeforums/gateway.php
Referer:
Benutzername: joe
IP-Adresse: 217.84.8.114
The signature is stored in usertextfield - "signature" ... As I am not as good in this - any way to change gateway.php to match these tables in VBulletin I'm using? BTW - It's an out of the box VB3.07 - no changes, hacks, whatever... :surprised:

[lierduh]

Ah oops. As I queried phpMyadmin, I don't have this field - I got 2,3,8 and 9, where 2 is city and so on. I disabled Signature in NNTP Settings Menu, but no success - I still get

Datenbankfehler in vBulletin 3.0.7:

Ungueltige SQL-Abfrage:
SELECT email, field1 AS signature, usertitle, customtitle
FROM user AS user
LEFT JOIN userfield AS userfield
ON user.userid = userfield.userid
WHERE user.userid = 1

mysql error: Unknown column 'field1' in 'field list'

mysql error number: 1054

Datum: 28.02.2005 22:26:20
Skript: http://www.mobilejoe.de/joeforums/gateway.php
Referer:
Benutzername: joe
IP-Adresse: 217.84.8.114
The signature is stored in usertextfield - "signature" ... As I am not as good in this - any way to change gateway.php to match these tables in VBulletin I'm using? BTW - It's an out of the box VB3.07 - no changes, hacks, whatever... :surprised:

Actually my file has the field name changed already. I can't remember when and why. Anyway, use this attached file instead, and you should be fine.

[joeMJ]

It works! :D Thank you sooo much !

[Odoin]

Could someone get this:
https://vborg.vbsupport.ru/showthread.php?t=60329 to work with the NNTP mod? I am willing to pay money...

[ironlogik]

hi there

can someone explain why none of the threads are actually showing on the forumdisply.php page? i see the thread and post counts on the forumhome (index), and if i click the thread name in the "last post" column on forumhome, it takes me to the thread no problem. its just not listing the damn threads on the forumdisply page.

please help. thanks.

you can see what its doing at: www.toyotanation.com/forum/

[ironlogik]

n/m problem solved.

it was the modified forumdisply.php from the "Warning System" hack

working perfectly.

BTW - news.astraweb.com is awesome!

[gmtalk]

Is there a way to tie usernames that I pull from yahoo groups or even newsgroups to existing members? I am testing a few feeds out on our test server that has a copy of all users from the live server. Several of our members post on the yahoo, nntp and the forum. I would like to get those members posts from the nntp and yahoo lists tied to their forum name.

I did try the vb built in one, but since the poster is "guest" it is not allowing it.

Any thoughts on this?

[BilldaCat]

When replying to a thread, the 'title' field is left blank. Did I mess up some setting, or is there a way to auto-populate that with 'Re: the-topic-being-discussed'?

Thanks!

[amphicar770]

I have a noob question but first wanted to say that this is an AWESOME hack. I will be using the email gateway to help in transitioning from YahooGroup to VB.

Anyway, for the following instruction under gateway settings I have to confess to having no clue what it means. My site is ammphicar770.com and I have set up a dedicated mailbox at that domain for exchange of the Yahoogroups message. Just have no clue what I should or should not enter for the following setting ...

This domain is used for the msgid of the outgoing post and also for the email address sent to the newsgroups. In the future, I plan to impliment a time limited email address system so replys can go from email to PM. To avoid spams attempting at your server. Please do not use a resolvable domain.
Email address domain email no-mx.amphicarforum.amphicar770.com

Thanks.

[Marv]

Hi,

I don?t know wether I?m the only one having this problem but I wouldappreciate if someone could give me a hint, where and how I could fixthis.

In my forums all posts appear as they should. That means theusenet-code is getting parsed into vb-code, spaces, blanklines..all topnotch.
My problem is the reversed parsing, means vb-code parsed into usenet-code and the appearing in the usenet.

A forum post which looks like this:
This is an example post and in this it has another quoted partlike that:Quoted message goes here. If this one has morethen 72 signs it becomes word wrapped as it should..normal text would go on here and (if long enough) becomes wrapped and parsed in the next line as normal and non-quoted text..

In the usenet post it shows up like this:
This is an example post and in this it has another quoted part like that:

In his post Marv mentioned:
> Quoted message goes here. If this one has more then 72 signs
> it becomes word wrapped as it should..normal text would go on here and
(if long enough) becomes wrapped and parsed in the next line as normal and not-quoted text..


instead of
This is an example post and in this it has another quoted part like that:

In his post Marv mentioned:
> Quoted message goes here. If this one has more then 72 signs
> it becomes word wrapped as it should..
[blank line]
normal text would go on here and (if long enough) becomes wrapped
and parsed in the next line as normal and not-quoted text..


So, it seems that a seperater is missing somewhere and reading of thoseusenet posts via newsreader really becomes a mess if you have a fewqoutes in it beside long text. I?ve tried to fix that on my own but Icouldn?t find out where I?ld have to insert the </br> .

Could someone do me the favor to have a look into the gateway.php ? May be I was just to blind to see..

[lierduh]

Hi,

I don?t know wether I?m the only one having this problem but I wouldappreciate if someone could give me a hint, where and how I could fixthis.

In my forums all posts appear as they should. That means theusenet-code is getting parsed into vb-code, spaces, blanklines..all topnotch.
My problem is the reversed parsing, means vb-code parsed into usenet-code and the appearing in the usenet.

A forum post which looks like this:


In the usenet post it shows up like this:


instead of


So, it seems that a seperater is missing somewhere and reading of thoseusenet posts via newsreader really becomes a mess if you have a fewqoutes in it beside long text. I?ve tried to fix that on my own but Icouldn?t find out where I?ld have to insert the </br> .

Could someone do me the favor to have a look into the gateway.php ? May be I was just to blind to see..

This occures when someone replies to the quote straight after the vbcode. eg. Instead of writing the reply in the new line. They reply was written like like:
...[/QUOTE]Reply was here

I will check the code out in a few days.

[Marv]

I will check the code out in a few days.

Thx, lierduh.

[mcncyo]

Is there anyway of putting word that you have in the Censorship Options got to a moderation area. I am try to figure out a good way of stop have spam and sex post put on my christian message board.

[szy]

Hello.

Thanks for your hack, but...

gateway.php seems to do nothing. What should be the reason? Wrong permissions? But - to what? I haven't found any directions about permissions?

This is the URL (http://www.wirtualna.warszawa.pl/forum2/gateway.php?debug=1). All files are transferred to server, MySQL table are created, groups is configured as id=30 (http://www.wirtualna.warszawa.pl/forum2/forumdisplay.php?f=30)

Thanks for help,
Szy.

[jzewatsky]

Thank you sooo much for writing and supporting this hack! This is exactly what my forum has needed!


Is there anyway of putting word that you have in the Censorship Options got to a moderation area. I am try to figure out a good way of stop have spam and sex post put on my christian message board.

Try the "Global Killfile" setting at the bottom of "NNTP Gateway Settings". If I read the instructions there, you could set the code to look for a word, set of words, string of characters in specific parts of the message. If that/those word(s) are present that message will not be turned into a thread. The text in the box should help you configure it to work the way you want. Hope that helps!

Anyone please correct me if I'm wrong.

Again thanks for the great hack!!!

[chas_h]

First of all, thanks for a wonderful hack. I've been using this successfully for weeks at my photo related forums.
My question is this. Can I have the same gateway.php working for 2 different installs of Vbulletin? I also have a gaming site hosted on the same server and would like to import different groups for that forum. Either that or can you run two seperate instances of gateway.php on the same server?

Has anyone tried either of these methods?

Tia,
Chas.

[AWS]

Just an FYI. This doesn't work with php 5.0.4. I have to use 4.3.11 to run gateway.php and 5.0.4 for the sites.
I upgraded php and noticed that my usenet forums last post was 2 days behind the rest of the forums. I ran it at command prompt and got the error mime.php and nntp.php have to be in ./includes folder. I even set full paths to try and make it work and it didn't. I set up 4.3.11 to run gateway.php only and it started working.

[mcncyo]

Thank you sooo much for writing and supporting this hack! This is exactly what my forum has needed!




Try the "Global Killfile" setting at the bottom of "NNTP Gateway Settings". If I read the instructions there, you could set the code to look for a word, set of words, string of characters in specific parts of the message. If that/those word(s) are present that message will not be turned into a thread. The text in the box should help you configure it to work the way you want. Hope that helps!

Anyone please correct me if I'm wrong.

Again thanks for the great hack!!!


thanks for the info. I didn't even seen that option.

[mcncyo]

I am having a big problem. I keep getting this error and can't find out why


<br /><strong>Warning</strong>: makemeathumbnail(includes/functions_image.php): failed to open stream: No such file or directory in <strong>/includes/functions_nntp.php</strong> on line <strong>735</strong><br /><br />
<b>Fatal error</b>: makemeathumbnail(): Failed opening required 'includes/functions_image.php' (include_path='/usr/local/lib/php:/usr/lib/php') in <b>/home/website/public_html/forum/includes/functions_nntp.php</b> on line <b>735</b><br />

[Ian Cunningham]

Is there any way to make the posts load into more than 1 forum at a time, and to stage the import slowly - so as not to bring the server to its knees?

I'm trying to import a few newsgroups with lots 50,000 posts in each and it brings my server to a halt!

[AWS]

Is there any way to make the posts load into more than 1 forum at a time, and to stage the import slowly - so as not to bring the server to its knees?

I'm trying to import a few newsgroups with lots 50,000 posts in each and it brings my server to a halt!
It has a built in function to pause after so many topics are imported. Check in the settings page.

[Ian Cunningham]

It has a built in function to pause after so many topics are imported. Check in the settings page.

I must be silly as I can't find that setting anywhere? Do you know the title of it?

I've just checked how you have implemented yours and that is similar to what I am trying to do - nice site! :)

[Marv]

This occures when someone replies to the quote straight after the vbcode. eg. Instead of writing the reply in the new line. They reply was written like like:
...Reply was here

I will check the code out in a few days.[/QUOTE]

Hi lierduh,

may be you already found a solution for the problem described in https://vborg.vbsupport.ru/showpost.php?p=628809&postcount=794 and just forgot to let us know how we can get rid of it?

Only wanna kindly bump it again ;)

[AWS]

I must be silly as I can't find that setting anywhere? Do you know the title of it?

I've just checked how you have implemented yours and that is similar to what I am trying to do - nice site! :)
yes it doesn't seem to be there any longer. I know there used to a way to pause the script for x number of seconds. Don't know what happened to it.

[Ian Cunningham]

yes it doesn't seem to be there any longer. I know there used to a way to pause the script for x number of seconds. Don't know what happened to it.

Not to worry, cheers anyway :)

I've got another problem now :speechless: I keep getting "PHP has encountered a Stack overflow" errors on certain posts, if I skip them it works fine, but I have to tell the script to start on a post count 1 higher than previously - is there any way to fix this? (or at least ignore it?).

[Devereaux]

Hi,

Sorry if this is obvious but I'm a bit confused - a few questions:

1. The readme says to set up the forums as usual. I did that. Should I be setting up the forums through the VB3 forum manager and then also go in and set up the newsgroups with the same names in the nntp settings??

2. Second, I input everything and the page just hangs when I execute the gateway.php file. Here is what I get - then the page says DONE in the status bar and nothing else happens, script locks for 30 minutes, no sign of posts being read into my forums:

Any help is GREATLY appreciated!

--------

Gateway version 2.3.2 2 group(s) gatewayed.

Connecting to server, server says: 200 Supernews server ready - posting allowed

Server responded after user name: 381 PASS required

Server responded after password: 281 authentication succeeded

Info for rec.models.rc.soaring at news20.forteinc.com: 211 1841 34684 36524 rec.models.rc.soaring group selected

[Devereaux]

Is anyone supporting this hack??

[James T Brock]

Hi,

Sorry if this is obvious but I'm a bit confused - a few questions:

1. The readme says to set up the forums as usual. I did that. Should I be setting up the forums through the VB3 forum manager and then also go in and set up the newsgroups with the same names in the nntp settings??

Yup.

2. Second, I input everything and the page just hangs when I execute the gateway.php file. Here is what I get - then the page says DONE in the status bar and nothing else happens, script locks for 30 minutes, no sign of posts being read into my forums:

Try it again with different newsgroups.

[lierduh]

Is anyone supporting this hack??

Not for at least another week from me while I am abroad.

[esfron]

@ chas_h

I have the same gateway.php working for two forums on the same server.

[esfron]

Just an FYI. This doesn't work with php 5.0.4. I have to use 4.3.11 to run gateway.php and 5.0.4 for the sites.


Bad news. :disappointed:

[esfron]

...Should I be setting up the forums through the VB3 forum manager and then also go in and set up the newsgroups with the same names in the nntp settings??



No. I am using different names for nntp settings and forums (subforums). It's working fine.

[Devereaux]

esfron,

So what is the key in terms of associating your NNTP newsgroups with forums. What I did, and it isn't working obviously, is I went into forum manager and created a category USENET. Then, I created two child forums under USENET. Then, I went into the NNTP Newsgroups panel and created two newsgroup configs. Each one is pointing at the respective forum, same name, created previously.

Maybe some explanation would help - I think I'm setting it up right though...

[esfron]

Here are my Newsgroup Settings for Comp.infosystems.www.servers.unix:

Newsgroup/Mailing list E-mail: comp.infosystems.www.servers.unix
Forum: Comp.info.servers.unix
etc.

I created one Usenet subforum (child forum) called Comp.info.servers.unix under my http forum Dedicated Server.

- Dedicated Server (http)
-- Comp.info.servers.unix (nntp)

[MrDegree]

Is there a way to change the "Originating IP" when posting to Usenet? I would like to say from my host's IP. Right now it's actually funneling the IP from the actual user on the my board who is doing the post.

Thanks.

[Devereaux]

I got my issues sorted...thx

[szy]

gateway.php seems to do nothing. What should be the reason? Wrong permissions? But - to what? I haven't found any directions about permissions?

This is the URL (http://www.wirtualna.warszawa.pl/vforum/gateway.php?debug=1). All files are transferred to server, MySQL table are created, groups is configured as id=2 (http://www.wirtualna.warszawa.pl/vforum/forumdisplay.php?f=2)
So, should I still expect your help, Lierduh?

Szy.

PS. I've changed the URLs above.

[szy]

Other question: has anyone this hack working fine with vB 3.0.7?

Szy.

[AWS]

Other question: has anyone this hack working fine with vB 3.0.7?

Szy.
I have it working on 3.0.7 on 2 sites.
Make sure you have the nntp server to connect to and usenet newsgroup setup in admin.

[MrDegree]

Is there a way to change the "Originating IP" when posting to Usenet? I would like to say from my host's IP. Right now it's actually funneling the IP from the actual user on the my board who is doing the post.

Thanks.

Anyone have any ideas on this?

[lierduh]

So, should I still expect your help, Lierduh?

Szy.

PS. I've changed the URLs above.

Don't know what is the problem. Perhaps something very basic is not configured properly, or perhaps the files are corrupted. You did sent the files as ASCII instead of binary?

[lierduh]

Is there a way to change the "Originating IP" when posting to Usenet? I would like to say from my host's IP. Right now it's actually funneling the IP from the actual user on the my board who is doing the post.

Thanks.

You would need to hack the hack for this.

[lierduh]

I must be silly as I can't find that setting anywhere? Do you know the title of it?

I've just checked how you have implemented yours and that is similar to what I am trying to do - nice site! :)

"Pause Between messages" "pause_seconds"

[lierduh]

Thx, lierduh.

Which version of the script are you using? I think I have already included the fix in the recently one of two releases.

Please check functions_nntp.php, around line 68, you should have:

$parsed_body .= "\n\n";

[SEO Report]

I have a big problem here, many posts are imported twice (some even 3+), causing me a maintenance nightmare with some bigger newsgroups.

I see that at least another member experienced this, has this bug been fixed yet?

Anyway, kudos for this wonderful hack!

[lierduh]

I have a big problem here, many posts are imported twice (some even 3+), causing me a maintenance nightmare with some bigger newsgroups.

I see that at least another member experienced this, has this bug been fixed yet?

Anyway, kudos for this wonderful hack!

You probably had cron/scheduled tasks set up before the initial message importation was completed.

The scripts has the ability to detect if there is another instance of script already running, but only if the other script was started to run less than 1/2 hour ago. As the initial importation may take well over 1/2hour. Two scripts could have run side by side causing double messages.

[szy]

Lierduh, thanks for your time, one more question...

gateway.php starts to work when i... delete these line:

require_once('include/functions.php');
... and then I get:
Gateway version 2.3.2 1 group(s) gatewayed.

Connecting to server, server says: 200 NNTP Service 6.0.3790.206 Version: 6.0.3790.206 Posting Allowed

Info for microsoft.public.access at msnews.microsoft.com: 211 15392 1 139321 microsoft.public.access

Getting message number 2:
... and nothing more.

So, could you please what exactly functions from functions.php you use in this hack? It will be easier to find the reason... :|

Thx,
Szy.

[lierduh]

Lierduh, thanks for your time, one more question...

gateway.php starts to work when i... delete these line:

require_once('include/functions.php');
... and then I get:
Gateway version 2.3.2 1 group(s) gatewayed.

Connecting to server, server says: 200 NNTP Service 6.0.3790.206 Version: 6.0.3790.206 Posting Allowed

Info for microsoft.public.access at msnews.microsoft.com: 211 15392 1 139321 microsoft.public.access

Getting message number 2:
... and nothing more.

So, could you please what exactly functions from functions.php you use in this hack? It will be easier to find the reason... :|

Thx,
Szy.

You can check the web server log and see what sort of errors you had. I couldn't remember what functions were used. It will be too time consuming for me to go through all the scripts and find the functions. Actually it is near impossible without writing an auto script to do so.

[szy]

In PHP error log:

[Wed Apr 27 11:16:26 2005] [error] PHP Fatal error: Cannot redeclare construct_phrase() in ./includes/functions.php on line 36

Lines 34-72 of vB's functions.php are:

function construct_phrase()
{
static $argpad;

$args = func_get_args();
$numargs = sizeof($args);

// if we have only one argument, just return the argument
if ($numargs < 2)
{
return $args[0];
}
else
{
// call sprintf() on the first argument of this function
$phrase = @call_user_func_array('sprintf', $args);
if ($phrase !== false)
{
return $phrase;
}
else
{
// if that failed, add some extra arguments for debugging
for ($i = $numargs; $i < 10; $i++)
{
$args["$i"] = "[ARG:$i UNDEFINED]";
}
if ($phrase = @call_user_func_array('sprintf', $args))
{
return $phrase;
}
// if it still doesn't work, just return the un-parsed text
else
{
return $args[0];
}
}
}
}

Hm?

Szy.

[Marco van Herwaarden]

This error means that the function "construct_phrase" is being defined for the second time. This can have different causes:
- Your custom script defines a function with the same name before calling functions.php.
- You made an edit somehow duplicating that function in functions.php
- You are using a "include" or "require" of functions.php instead of "include_once" or "require_once" making the functions.php to be loaded twice.

And probably some more i didn't think of now.

[szy]

But... it is fresh forum, no changes at all, no modification... and files from Lierduh's zip file. Arggh. I'll go crazy :/

Thanks.

Szy.

[szy]

Is it really correct, to load all the functions.php to strip bb code only?

Lines 59-60 of gateway.php
// strip_bbcode
require_once('includes/functions.php');

I have no idea, what can duplicate functions :/

Szy.

[lierduh]

But... it is fresh forum, no changes at all, no modification... and files from Lierduh's zip file. Arggh. I'll go crazy :/

Thanks.

Szy.

The construct_phrase function has been declared twice!

Do
#grep 'function construct_phrase' * -r
Under the console shell if possible. Otherwise, resend the files again.

[kevinrstruck]

Any idea why I would be able to get posts but not send?

[szy]

#grep 'function construct_phrase' * -r

It's present in two files:

./includes/functions.php
./clientscript/vbulletin_global.js

Right or wrong, if the second is javascript? (Un)fortunately, I'm not a coder ;)

Szy.

[Marco van Herwaarden]

Do another grep but now for 'includes/functions.php' Will give you a whole list, but only interested in lines with "require" or "include" (not require_once or include_once).

[lierduh]

It's present in two files:

./includes/functions.php
./clientscript/vbulletin_global.js

Right or wrong, if the second is javascript? (Un)fortunately, I'm not a coder ;)

Szy.

Which php version are you running? If it is too old, consider upgrade. Also try out a non-edited php.ini if possible.

If all the files have not been edited and not corrupted, then your problem must be caused by the server/setup. In case you are running the latest php 5, it may have features to cause this. I am not running php 5, so the scripts may not work with php 5.

[szy]

I really appreciate your help.

PHP version is 4.3.10. Too old?

Szy.

[SEO Report]

lierduh,

Spam is becoming really annoying in my case, and while the kill file helps a lot, it isn't sufficient due the crazy number of rubbish posted msg :(

How about adding regular expression support to the killfile routine? (might not be an easy task, I don't know...). I'm not a php programmer, but after looking at the killfile_match() function, I figured that one can strip title and body text and test them against a configurable list of reg expressions, we would have a great antispam filter!

Perhaps something like :

foreach ($RegExpSetting AS $eachRegExp)
preg_match_all ($eachRegExp, $eachRegExp, $killfile_array);

What do you think?

-k

[lierduh]

lierduh,

Spam is becoming really annoying in my case, and while the kill file helps a lot, it isn't sufficient due the crazy number of rubbish posted msg :(

How about adding regular expression support to the killfile routine? (might not be an easy task, I don't know...). I'm not a php programmer, but after looking at the killfile_match() function, I figured that one can strip title and body text and test them against a configurable list of reg expressions, we would have a great antispam filter!

Perhaps something like :

foreach ($RegExpSetting AS $eachRegExp)
preg_match_all ($eachRegExp, $eachRegExp, $killfile_array);

What do you think?

-k

That could cause a support nightmare. We have already had quite a few posts regarding how to use the existing simple killfile format.:)

I have allowed custom settings to be created via the Admin interface, so a killfile with Regular Expression can be entered through Admin interface. You can then add custom functions to the scripts...

[lierduh]

I really appreciate your help.

PHP version is 4.3.10. Too old?

Szy.

No.
You should not have this problem if no scripts have been modified.

[sdsvtdriver]

I've read through this entire thread and surprised that no one else has seen this error.

This happens on the same message number repeadedly. I've removed the forum, created a new one, and initiated a download. It always stops at this message with this error:

Getting message number 567216: PHP has encountered a Stack overflow

When I adjust the message number to skip it via admin CP, it works fine and then again I get the message:

Getting message number 567237: PHP has encountered a Stack overflow

Any suggestions?

[sdsvtdriver]

On a seperate note:

I set up the gateway on another board. Instead of the attachments getting decoded, I'm getting the raw data inserted into posts.

for example:

=ybegin line=128 size=111070 name=image-4.jpg
))=J*:tpsp*+++*r*r**)*m*-,,-,,----.--./2//../411026466545578<:78;855:@:;=}>???69AB@>B<>?>)*m+-.././3//3>757>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>)?*;2,?+?-+L*,;+-;+)?*F**,-++++*********-.,/0*1+2)?*E+*,-+++**********+,*-./01)*6-+*,:-:**+?5ո

The image import works fine on the other board, but for the life of me I can't figure out why this isn't working on board #2.

Ideas?

[Ian Cunningham]

Is there any way to make this script use multiple connections, as it can be slow at importing large Newsgroups?

[SEO Report]

Is there any way to make this script use multiple connections, as it can be slow at importing large Newsgroups?

Yep, it would certainly speed up the import process on my end, too. But I'm not sure it's easily feasable :rolleyes:

How about the ability to mark the currently ported newsgroup as "locked". This way, one can run multiple instances of gateway.php, and each instance would import a different newsgroup (skipping the currently locked newsgroups).

I know, I know. It's not what you're asking, but it will help if you're importing several ng at once, no?

[mcncyo]

Y
How about the ability to mark the currently ported newsgroup as "locked". This way, one can run multiple instances of gateway.php, and each instance would import a different newsgroup (skipping the currently locked newsgroups).



I would like this options also. Sometimes some of my newsgroups gets alot of post all of a suden and then i don't get download from all of the groups because it takes so long to download the new groups.

[flicknut]

Is it normal for the time of the imported messages to be the time they are actually imported into the local forum rather than the time they are posted on USENET? I just installed the hack, and 3,008 messages were uploaded with the same time on each one.

[kevinrstruck]

Is it normal for the time of the imported messages to be the time they are actually imported into the local forum rather than the time they are posted on USENET? I just installed the hack, and 3,008 messages were uploaded with the same time on each one.


Yes, this is normal since the times displayed are the times the post was posted to your forums. If you have 3800 messages, most likely that took a while so the older messages will be a couple minutes or more older than the newest messages.

[AWS]

There is an option to set post time to the time it was posted to usenet. Option number 11, I beleive, on usenet_settings.php.

[sdsvtdriver]

anyone else have issues with pictures?

I pull down pictures from a drag racing usenet forum. They come across fine as attachments in the forums, but they pictures appear to have been decoded improperly. There are colorbars and distortion in the images. If I pull the pictures down with a newsreader, they look fine.

Ideas?

example:
http://www.domesticmuscle.com/dmforums/showthread.php?t=663

[flicknut]

AWS, thanks for the fix with the post time.

Is there a way to completely disable the forum thread and user's profile from being attached to the end of a message? I just deleted these variables completely, but I haven't tested it yet.

Also, when someone creates a new thread on my board, why is it imported back to my board after it's exported out? For example, here is the original thread from my board:

http://www.hdtv-info.org/forum/showthread.php?t=483

And here is the very next thread being duplicated after the import:

http://www.hdtv-info.org/forum/showthread.php?t=484

[AWS]

AWS, thanks for the fix with the post time.

Is there a way to completely disable the forum thread and user's profile from being attached to the end of a message? I just deleted these variables completely, but I haven't tested it yet.

Also, when someone creates a new thread on my board, why is it imported back to my board after it's exported out? For example, here is the original thread from my board:

http://www.hdtv-info.org/forum/showthread.php?t=483

And here is the very next thread being duplicated after the import:

http://www.hdtv-info.org/forum/showthread.php?t=484
There is also an option to not send the thread and profile link. Option 7 or 8 I think. I have that disabled and then define a default footer to attach which is the second to last option.
I've never had a problem with threads from the board being duplicated.
Do you have more than one feed going into one forum?

[flicknut]

There is also an option to not send the thread and profile link. Option 7 or 8 I think. I have that disabled and then define a default footer to attach which is the second to last option.
I've never had a problem with threads from the board being duplicated.
Do you have more than one feed going into one forum?

Thanks for your help!

I only have one HDTV newsgroup going into my forum, but I changed the "No Organization Check" variable, and it stopped the duplicate messages. Are there any negatives to changing this variable?

Okay last question. How do I add a carriage return inside my default footer? I tried \n but this didn't work. Right now when someone creates a post, it puts the default footer on the same line as the username. For example, my outgoing posts look like this:

--
hdtvnutThis post originated from http://www.hdtv-info.org/forum/

[lierduh]

Also, when someone creates a new thread on my board, why is it imported back to my board after it's exported out? For example, here is the original thread from my board:


Please, go through settings at least once.

[lierduh]

Is there any way to make this script use multiple connections, as it can be slow at importing large Newsgroups?

It is not that the connection takes so much time, it is the time it needs to insert the imported posts into the forum system. It needs to build index, find the similar threads... Normal user posts message one by one, we are 'posting' perhaps hundreds of messages in one go. If your server is slow, then it will take a long time.

[lierduh]

Thanks for your help!

Okay last question. How do I add a carriage return inside my default footer? I tried \n but this didn't work. Right now when someone creates a post, it puts the default footer on the same line as the username. For example, my outgoing posts look like this:

--
hdtvnutThis post originated from http://www.hdtv-info.org/forum/

In
includes/functions_nntp.php
find
$signature .= $nntp_settings['default_footer'] . "\n";
change it to
$signature .= "\n" . $nntp_settings['default_footer'] . "\n";

should do the trick.

[Ian Cunningham]

It is not that the connection takes so much time, it is the time it needs to insert the imported posts into the forum system. It needs to build index, find the similar threads... Normal user posts message one by one, we are 'posting' perhaps hundreds of messages in one go. If your server is slow, then it will take a long time.

Ok, cheers :)

I do have a wierd problem with the script at the moment, it just stops importing certain messages and it exits the while script. It does this every time it runs and I have to tell it to skip manually. Do you know why it might be doing this, or how the script can just skip it if it can't import it?

[PeterKjaer]

Hi

I´m trying to remove the "reply buttons as told in the "hacking_guide" but can't find the showthread template....anyone who can tell me where to find it?

im running 3.0.7

/peter

[esfron]

Ok, cheers :)

I do have a wierd problem with the script at the moment, it just stops importing certain messages... What php version are you running ? Take a look at https://vborg.vbsupport.ru/showpost.php?p=636085&postcount=801
.
.

[SEO Report]

It is not that the connection takes so much time, it is the time it needs to insert the imported posts into the forum system. It needs to build index, find the similar threads... Normal user posts message one by one, we are 'posting' perhaps hundreds of messages in one go. If your server is slow, then it will take a long time.

So If I understood you correctly, if I comment this line in functions_nntp.php


// Index post for searching
build_post_index($postid, $foruminfo);


and then use these functions (in Admin CP -> Import & Maintenance):

-> Rebuild Forum Information
-> Rebuild Similar Threads

(or perhaps Rebuild Search Index)

that will speed up the import process since the rebuild function will be called just once (at the end), is that correct?

(imported newsgroups are shown to visitors only after the import process is finished)

[SEO Report]

Well, I don't think I need this anymore...

For those wishing to speed up the import process, you can setup a private test forum, setup the NNTP hack, import newsgroups and then use impex to copy the imported data from the private forum to the real one.

Not sure if this is a good idea, I'm going to try it right away...

[Slave]

hmm .. not sure if this has been mentioned before ..

Hacks been working brilliantly and there's only one thing I've noticed which bugs me ..

When looking at the list of threads in a forum that is of USENET posts and you hover your mouse over a thread title instead of getting the first post wording pop up you seem to get the last post in the thread.

This is not the normal way the forums work. I've looked in the settings and I can't see anything that would effect this. Is there anyway I can get the first post to show instead of the last post?

As a side note, I did have it set to show time a post was imported into the forums .. I've now changed that to show post made on USENET .. not sure if that will make a difference ..

Any ideas?

[Slave]

Just spotted this thread ..

https://vborg.vbsupport.ru/showpost.php?p=524544&postcount=220

Will this solve my problem? .. It's from last year so I would of thought it would of been incorporated into the hack .. has it?

I don't want to add it to my gateway.php if it's already been done somewhere else in the code ..

[Ian Cunningham]

What php version are you running ? Take a look at https://vborg.vbsupport.ru/showpost.php?p=636085&postcount=801
.
.

I'm using 4.3.x so it should work :(

[David_R]

So If I understood you correctly, if I comment this line in functions_nntp.php


// Index post for searching
build_post_index($postid, $foruminfo);


and then use these functions (in Admin CP -> Import & Maintenance):

-> Rebuild Forum Information
-> Rebuild Similar Threads

(or perhaps Rebuild Search Index)

that will speed up the import process since the rebuild function will be called just once (at the end), is that correct?

(imported newsgroups are shown to visitors only after the import process is finished)
does this idea works for you ?
please post your comments if you are able to speed up this SLOW process anyhow.

thanks.

[pco]

Just an FYI. This doesn't work with php 5.0.4.

Can't confirm, working fine with 5.0.4 :)

[sdsvtdriver]

Is this hack being supported anymore? Haven't seen much input from the programmers lately...

[mcncyo]

he just posted on may 13

[sdsvtdriver]

Ahh, perhaps my questions were just overlooked :)

[PeterKjaer]

Hi,

Great MOD you have, but i have some problems;

why does a titel likeDanske skrot f?rger som kunstige rev i DK change to =?iso-8859-1?q?Danske_skrot_f=E6rger_som_kunstige_rev_i_DK?="

You can see it here http://www.dacor.dk/forums/forumdisplay.php?f=9

some have told me it can be a MIME problem, but is there a solution for this?

/Peter

[pco]

Because your PHP is compiled without imap which is needed for imap_mime_header_decode to work in gateway.php. Furthermore this hack doesn't handle utf-7/8, for that to work gatway.php needs to be modified further (for instance with one of the comments mentioned under imap_mime_header_decode in the PHP manual).

[SEO Report]

David_R,

(Sorry for the late reply)

does this idea works for you ?

I didn't try it (not yet :)). I'm not sure, I'm afraid it will crash my server.


please post your comments if you are able to speed up this SLOW process anyhow.


I installed a private test forum and setup this hack on it (total of 3 different forums with their respective gateway.php instance running every hour), this way I could simulate multi-threading & hopefully speed up the import process. The msg imported into the test forum would be ported to the live one using impex (very fast, since both forums are located within the same machine)

I don't have enough data to make any conclusion, but as far as I can see, the speed is almost the same.

Perhaps the script is already running at maximum speed, or perhaps as the author suggested, the import is slow because of the similair threads thing, I don't know (I have a dedicated box with 100Mbps, my nntp provider doesn't limit download speed).

In my case, getting a dedicated box and switching to a better nntp provider helped me speed up the process.

HTH,
-k

[David_R]

David_R,

(Sorry for the late reply)



I didn't try it (not yet :)). I'm not sure, I'm afraid it will crash my server.



I installed a private test forum and setup this hack on it (total of 3 different forums with their respective gateway.php instance running every hour), this way I could simulate multi-threading & hopefully speed up the import process. The msg imported into the test forum would be ported to the live one using impex (very fast, since both forums are located within the same machine)

I don't have enough data to make any conclusion, but as far as I can see, the speed is almost the same.

Perhaps the script is already running at maximum speed, or perhaps as the author suggested, the import is slow because of the similair threads thing, I don't know (I have a dedicated box with 100Mbps, my nntp provider doesn't limit download speed).

In my case, getting a dedicated box and switching to a better nntp provider helped me speed up the process.

HTH,
-k
I have tried with 3 nntp providers on a Dual Xeon with 8 GB RAM dedicated box.
But no improvements. It takes more then 12 hours to import about 2,00,000 posts :(

[SEO Report]

I have tried with 3 nntp providers on a Dual Xeon with 8 GB RAM dedicated box.
But no improvements. It takes more then 12 hours to import about 2,00,000 posts :(

Did you mean 2,000 or 2,000,000 (millions)?

2 Millions in 12h is great IMO. I have a dedicated box (3Ghz, 1GB RAM) and I'm averaging 200,000 *REAL* msg/day (I'm using GigaNews).

But, if you meant 2,000 (or 20,000)...then yes, it *is* slow.

Can you confirm?

Perhaps you should check with your nntp provider if they're limiting the speed at wich you can download msg.

-k

[irubin]

Hello

I'm using this hack with some high-volume groups. Most of the time it works ok, however there are some problems.

1) not all newsgroup posts are downloaded to forums.
i debugged this thing and i know why but don't know how to fix it

the post numbers on nntp server are not in correct order, replies have earlier numbers than the original post which starts a thread. This causes the replies to be inserted first as new thread and then the thread starting post to be inserted as another new thread. I can't think of anything else then running a script from time to time which would solve such things using msgids and references. Any other idea?

for example one of the threads have the following server post numbers:


616189
616185
616187
616233
616248


and the result is two threads,
one

616185
616187


and second

616189
616233
616248


2) some of replies (on forums) to downloaded posts are not posted to newsgroup. Even though they have "isusenetpost=1" they do not appear on newsgroup. When i make "isusenetpost=0" in DB and change $nntp_settings['last_postid'] to include this post and run gateway.php the post is uploaded correctly. The problem is only for some of the posts not all and i did not find out yet anything that would give me a clue about this problem. Msgids and references are ok

Thanks

[lierduh]

How often does your script run? If a reply arrives at your NNTP server before the original message, then threading could be wrong. The chance for this to happen will be reduced greatly if the time between the running of the script is increased. Also you can try the option to thread your messages by subject instead of Msgids. There is an option in the settings. I can't remember how I implemented this, but it is worth a try.

I can't explain the second problem. You can turn on the logging by editing the setting at the beginning of gateway.php. It will email you the debug message each time the script is run. If for any reason the server rejects the message, the debug message should show the error message.

Hello

I'm using this hack with some high-volume groups. Most of the time it works ok, however there are some problems.

1) not all newsgroup posts are downloaded to forums.
i debugged this thing and i know why but don't know how to fix it

the post numbers on nntp server are not in correct order, replies have earlier numbers than the original post which starts a thread. This causes the replies to be inserted first as new thread and then the thread starting post to be inserted as another new thread. I can't think of anything else then running a script from time to time which would solve such things using msgids and references. Any other idea?

for example one of the threads have the following server post numbers:


616189
616185
616187
616233
616248


and the result is two threads,
one

616185
616187


and second

616189
616233
616248


2) some of replies (on forums) to downloaded posts are not posted to newsgroup. Even though they have "isusenetpost=1" they do not appear on newsgroup. When i make "isusenetpost=0" in DB and change $nntp_settings['last_postid'] to include this post and run gateway.php the post is uploaded correctly. The problem is only for some of the posts not all and i did not find out yet anything that would give me a clue about this problem. Msgids and references are ok

Thanks

[irubin]

How often does your script run? If a reply arrives at your NNTP server before the original message, then threading could be wrong. The chance for this to happen will be reduced greatly if the time between the running of the script is increased. Also you can try the option to thread your messages by subject instead of Msgids. There is an option in the settings. I can't remember how I implemented this, but it is worth a try.

I can't explain the second problem. You can turn on the logging by editing the setting at the beginning of gateway.php. It will email you the debug message each time the script is run. If for any reason the server rejects the message, the debug message should show the error message.

Thank you for your reply. Ny script runs once every hour. I don't think that changing to thread by subjects would help. Also searching the DB for subjects is too slow when there are nearly 400 000 posts. The problem is when you get messages from the server from $lastmsg to $max, replies get downloaded first and inserted as new thread, then the thread starting post is downloaded and inserted as another new thread. I don't think that threading by messages would delete the first thread and link it to the second thread.

Thanks

[Ian Cunningham]

What exactly are the isusenetpost and msgid fields needed for? They are indexes in the post thread, but I think it might be slowing down inserting new posts for the rest of the forum?

[sdsvtdriver]

Has anyone figured out or modded the hack to exclude certain forums from sending posts to the Usenet? I have some forums I'd like the users to be able to post to the Usenet on, but other's I wouldn't.

[DigitalCrowd]

This is an awesome script, BTW. My issue is that I have one forum with around 200,000 posts and it is SOOO SLOW for it to sync up that database. It even stops the entire forum from responding while it's doing it's thing. Once it gets to importanting, it is fine, but the initial scan or whatever it's doing, is dog slow.

Any ideas or solutions?

Also, when it comes to filtering, it doesn't seem to filter SUBJECTS. I'd really like for it to do that, doing a H or B for the filter doesn't seem to work for subjects.

[irubin]

Hello

I think the script works much better if it's run using plain cron, not vB scheduler. If i run it through vB scheduler and ouput some variables inside it they are NULL or have strange values.

Also i think one of the problems is not unique msgids. Now i'm using seconds since epoch + microseconds + user name and it helps.

Hope it will help someone

[allan grossman]

Has anyone figured out or modded the hack to exclude certain forums from sending posts to the Usenet? I have some forums I'd like the users to be able to post to the Usenet on, but other's I wouldn't.

Just remove posting privileges in the forums where you don't want users to post :)

[allan grossman]

Is anyone else having problems with A Small Orange and Giganews? I got an email from someone else saying their Usenet forums stopped receving posts so I checked mine - nothing new since May 21.

[allan grossman]

Is anyone else having problems with A Small Orange and Giganews? I got an email from someone else saying their Usenet forums stopped receving posts so I checked mine - nothing new since May 21.
ASO is fixed. They stood up a new firewall and forgot to open port 119 ;)

[CarolinaKid]

I assume I am thinking this hack is something other then what it is. I set it to grab group alt.binares.dvdr well that was a mistake. Is there a a way to get it to grab just the headers or something not the whole attachment that is just a bunch of garbage in the post casue it showed up like ASADJJKMSDA><MDSNDLSDJMD>SAD witch i feel sure is the rar file just not as a atachment. I guess basicly I was thinking it would something like newzbin where it just showed the headers. ( altho would be nice if you could make it so it would make a nzb file to download. ) Do I have this hack all wrong in my head?

[Skalek]

Sorry if this has been asked already. I am in the process of setting my site up and importing a lot of newgroup posts. Every once in a while it will just stop for no reason and give no error at all. Then I can change the last run time and start it again.

Any idea what this could be?

[xnt]

Is there a way to support one mailing list email (eg: 1 Yahoo group) going to different forums via the prefix option? Can I remove the database uniqueness restriction on this field (NEWSGROUP in NNTP_GROUPS table) or are there any other ways around this ???

TIA -Xuan

[coreymcl]

How do I make it look for new post. Also do I have to have the last message ID if I am just starting this hack up for the first time?

[Razz]

Sorry if this has been asked already. I am in the process of setting my site up and importing a lot of newgroup posts. Every once in a while it will just stop for no reason and give no error at all. Then I can change the last run time and start it again.

Any idea what this could be?

The time the script will execute before timing out is controlled by your host in the php.ini file.

If you have a low timeout time it can be a pain doing the first import, you could always use the crontab and leave it for a day to do itself.

[Razz]

How do I make it look for new post. Also do I have to have the last message ID if I am just starting this hack up for the first time?

It will only look for new posts if you put it on crontab or manually run it via the gateway file.

You don't need a last message ID for the first run, it'll fill that in automatically after.

[Skalek]

I see the recommended cron job is :

lynx -source http://domain/forumdir/gateway.php

Is there any reason we can not just set our cron job to :

php /pathtogateway.php/gateway.php

?


Also has anyone had any success running multiple instances of gateway.php for multiple forum installations on the same server? Any problems?

Last but not least, is their a recommended maximum amount of newsgroups that we should do per forum instance or will gateway.php handle whatever you got?

[AWS]

I see the recommended cron job is :

lynx -source http://domain/forumdir/gateway.php

Is there any reason we can not just set our cron job to :

php /pathtogateway.php/gateway.php

?


Also has anyone had any success running multiple instances of gateway.php for multiple forum installations on the same server? Any problems?

Last but not least, is their a recommended maximum amount of newsgroups that we should do per forum instance or will gateway.php handle whatever you got?
I run 3 instances of gateway.php running on 3 different forums and don't have any problems.

[mcncyo]

Just an FYI. This doesn't work with php 5.0.4. I have to use 4.3.11 to run gateway.php and 5.0.4 for the sites.
I upgraded php and noticed that my usenet forums last post was 2 days behind the rest of the forums. I ran it at command prompt and got the error mime.php and nntp.php have to be in ./includes folder. I even set full paths to try and make it work and it didn't. I set up 4.3.11 to run gateway.php only and it started working.


How did you do this? I would also like to run php 5 but can't seem to figure out how to make gateway.php to run 4.3.11

[AWS]

How did you do this? I would also like to run php 5 but can't seem to figure out how to make gateway.php to run 4.3.11
I run Windows and IIS so I just set IIS to use php5 isapi filter and for scheduled tasks and command line php 4.3.11 cgi is used. For a while I was using .php and .phtml extensions as php5 and .php4 for php4. Have to add a registry entry for php5 to point to php.ini and for php4 set the user path.
I don't know how you'd do it on Linux, but, it can be done.

[xnt]

How did you do this? I would also like to run php 5 but can't seem to figure out how to make gateway.php to run 4.3.11

For Unix you can set up a cron job and use the 4.3.11 PHP CGI program to run gateway.php.
eg: this will run every 10 mins
1,11,21,31,41,51 * * * * /path-to-php4.3.11/php-4.3.11 -f /path-to-script/gateway.php

BTW, I am trying to setup a new gateway for a forum and I only want futures postings to be forwarded to a mailing list, not old posts. How could I do this? Can I set the Last Max postid # to the last posting # of that forum??? TIA

[Skalek]

Yeah I got that all working, but now I have a problem where the script is not following the its own time constraints. From what I understand it is supposed to run no longer than 30 minutes. Also another instance should not run within 30 minutes of the first starting. This makes sense so that you dont have multiple copies running at the same time.

My problem is that gateway.php seems to be running for 2 hours + so that if I cron it multiple instances will occur. Anyone else run into this problem?

[xnt]

I took a backup of my vb database to my home linux box to test out NNTP gateway to a Yahoo group mailing list. I only enable 1 sub forum and left the default value of 0 on the Last Max postid field. For the first initial run, the gateway sent ALL messages from ALL forums including those msg from an un-related PRIVATE forums to the Yahoo list??? Luckily! this is just a test else I could be in big trouble. I believe this problem only occurs in the initial run.

I just switch NNTP on for the real server with appropriate Last MAx postid set to the last posting #. However, I ran into 2 issues:


I do not see any messages arriving at Yahoo. When using with debug option, it appears that messages are sent ??? BTW, Importing messages from a POP3 account works.
when running the gateway.php script via PHP CGI (command line), I encountered an error message: 'Unable to add cookies, header already sent.'


The only different is: my hosting company uses PHP 4.3.10 whereas I have 4.3.11 at home. Perhaps there are some other restrictions?? I use 1and1.com btw.

[Electronic Punk]

Any idea of the modifications that need to be made to get this working with 3.5 beta?

[mcncyo]

I am going to compile php as cgi mode just for this script what do i need to include to make it run?

[krohnathlonman]

<b>Fatal error</b>: Call to undefined function globalize() in <b>/home/usenetma/public_html/gateway.php</b> on line <b>49</b><br />

Vbulletin 3.5 beta 2 error message.....

I'll pay $50 to the first person who creates a VB 3.5 compatible version of this... I'm sure some others would be willing to chip in too

[krohnathlonman]

I'm working on the mods to make this work with 3.5 and I've found where the post table has changed a bit so I'm working on getting things working right with that...

All DB queries have changed and the globalize has changed..... so it is a decent amount of work to get this working

[mcncyo]

For Unix you can set up a cron job and use the 4.3.11 PHP CGI program to run gateway.php.
eg: this will run every 10 mins
1,11,21,31,41,51 * * * * /path-to-php4.3.11/php-4.3.11 -f /path-to-script/gateway.php





it didn't work it just output the html to the display


-bash-2.05b# /usr/local/php4-cgi/bin/php -f /home/website/www/forum/gateway.php4

<html dir="" lang="">
<head>
<title>My Christian Network's christian forum</title>


</head>
<body>


<br />
<br />
<br />

<table class="tborder" cellpadding="" cellspacing="" border="0" width="70%" align="center">
<tr>
<td class="tcat"></td>
</tr>
<tr>
<td class="panelsurround" align="center">
<div class="panel">
<div align="">


<!-- main error message -->


<blockquote><p>Unable to add cookies, header already sent.<br />
File: <br />
Line: 0<br /></p></blockquote>


<!-- / main error message -->


</div>
</div>
<!--
<div style="margin-top:px">
<input type="submit" class="button" value="" accesskey="s" onclick="history.back(1); return false" />
</div>
-->
</td>
</tr>
</table>

<br />


<!-- forum jump -->
<table cellpadding="0" cellspacing="0" border="0" align="center">
<tr>
<td></td>
</tr>
</table>
<!-- / forum jump -->


<br />



</body>
</html>

[krohnathlonman]

I got parts of the import functioning on 3.5... it appears to grab the text but attatchments and debugging output aren't working and I haven't had the time to do any further testing.

The main thing I need for my new project is the inline mod tools and attatchments... I've decided to stick with 3.0.7 and do the inline mod hack and stay there.

[Electronic Punk]

ah well :(

[yellowchaser]

Is there a way to have the username display as something other than "Guest" to something like "UseNet User" instead when posts are imported in from the newsgroups. Without changing the default guest account on VB. I know this sounds trivial but I have actually had people complain that it makes them look like they posted from the site rather than the usenet group.

[Kadence]

Tremendous mod :)

Only problem is the speed. I seem to be getting only about 3,500 posts/hour, whereas it takes under a minute to download that number through NNTP on a newsreader. But I suppose that's probably because of the vBulletin database functions taking up a lot of time, rather than the download of articles itself...?

Anyway, a very helpful mod, and much appreciated.

I see some people here having problems posting with Giganews; not being able to upload articles to Usenet (error code 440). If you have just signed up with them, this is because of the free trial period?during the free trial period, you can download articles, but you can't post; they say it's because of preventing spam. You have to manually bypass the trial period in order to be able to post right away.

[krohnathlonman]

kadence, the biggest issue you'll have with the speed is how fast your hard drives are. Inserting loads of data will take fast drives housing your MySQL servers. I suggest at least 10k SCSI drives with 15k obviously being faster.

[xnt]

it didn't work it just output the html to the display

I believe you must be using PHP <= 4.3.10. In this case, just take out the -f option and use something like:

1,11,21,31,41,51 * * * * cd $HOME/forum; php gateway.php > $HOME/tmp/null

[Kadence]

After a lot more work than I expected :speechless:, I was able to modify this so that it works with 3.5 Beta 3.

What I did:

Replace $DB_site with $db in gateway.php, nntp_groups.php, nntp_settings.php, and functions_nntp.php.
In those same files, replace all instances of globalize( with $vbulletin->input->clean_array_gpc( ; and the tricky part: alter $_GET, $_POST, and $_REQUEST parameter inputs within clean_array_gpc to 'g', 'p', and 'r' respectively; and change the variable calls from $variablename to $vbulletin->GPC['variablename'].


Note that altering nntp_groups.php isn't entirely necessary, as the nttp_groups table can be directly modified via phpMyAdmin.

In nntp_settings.php the affected lines (in terms of the original line numbers) are around lines 92, 107, 141, 192, and 223. In nntp_groups.php the lines are around 324, 336, 368, 414, and 451.

Rather than replace all variable instances with $vbulletin->GPC['...'] calls, I just set new variables with the same names as the old ones, using $vBulletin->GPC['...']. e.g., add the line $ngid = $vBulletin->GPC['ngid'] right after the clean_array_gpc call; the variable $ngid can then be used the same as before.

One thing that gave me a bit of trouble was line 241 (in my modified file, line 263) of nntp_groups.php. In this line $group[?forum?] must be changed to ?forum?. Otherwise the form variable name comes up as ?0? on the post form, rather than ?forum?; and thus the table update doesn't work.

Note that I made a change to gateway.php line 71, and I'm not sure if it was complete; this would affect the 'log' and 'debug' variables, but those don't seem to be used anywhere that I could find.

The 4 files that were changed (nntp_groups.php, nntp_settings.php, gateway.php, and functions_nntp.php) are attached in .zip format. Note that I did not test thoroughly, so "Use at your own risk" warnings apply!

To add a menu item in the admin control panel, copy the file "cpnav_nntp_gateway.xml" to the /includes/xml directory.

[Kadence]

Ah, duh?$debug is used when passing ?debug=1 in from the URL ;) Without it the logging() function doesn't work.

So I added the following lines after line 71 in gateway.php:

$log = $vbulletin->GPC['log'];
$debug = $vbulletin->GPC['debug'];

The .zip file in the post above has been updated.

[AWS]

Ah, duh?$debug is used when passing ?debug=1 in from the URL ;) Without it the logging() function doesn't work.

So I added the following lines after line 71 in gateway.php:

$log = $vbulletin->GPC['log'];
$debug = $vbulletin->GPC['debug'];

The .zip file in the post above has been updated.
Thanks much. I'll give it a try on my test box.

[Gottcha]

can someone help me here.... i have most of it all installed but the file tries to download...so i went to the ms site and attempted to edit the registry. i found the key and added a new value and got it all up to the point of adding the value data. It wont let me add HEX 0x1. Id really like to install this and get it all working...thanks in advance.

Key: HKEY_CURRENT_USER\Software\Microsoft\Windows\Curre ntVersion\Internet Settings

Value name: IsTextPlainHonored
Value type: DWORD
Value data: HEX 0x1

FIXED IT....WELL ACTUALLY RAN THE FILE ON ANOTHER MACHINE

[Kadence]

OK?I made some more changes :)

There was an issue with form variable names on nntp_groups.php line 278 (original line 256), of the same variety as the print_forum_chooser problem on line 263 (241). This was causing problems with "Add Newsgroup", rather than "Edit"; when trying to add a newsgroup, the forum would be set to 0, rather than the forumid.

Also, I replaced all instances of $vboptions['...'] with $vbulletin->options['...'] and global $vboptions with global $vbulletin in functions_nntp.php. Looks like this affects a lot of attachment stuff.

I have no idea if attachments work now; perhaps someone will test it and share their results :squareeyed:

My earlier post has the updated .zip file.

[danrak]

Would it be possible to use this to share posts between sites? How would it be done?

[lierduh]

Tremendous mod :)

Only problem is the speed. I seem to be getting only about 3,500 posts/hour, whereas it takes under a minute to download that number through NNTP on a newsreader. But I suppose that's probably because of the vBulletin database functions taking up a lot of time, rather than the download of articles itself...?



vB indexes all the words in the post contents, that is why it is very fast to search a term from the post. Whereas a normal news reader usually only index the subject. To find a keyword within the post would basically require a full article scan. I believe the indexing takes up most of the time for importing.

To speed up a bit, one can delete the index for 'msgid' in the post table, and reindex that field with a smaller size. It is quite easy to do with myphpadmin. Just set the size of the index to 10 or 15. That might(according to mysql manual) improve some speed.

[lierduh]

Yeah I got that all working, but now I have a problem where the script is not following the its own time constraints. From what I understand it is supposed to run no longer than 30 minutes. Also another instance should not run within 30 minutes of the first starting. This makes sense so that you dont have multiple copies running at the same time.

My problem is that gateway.php seems to be running for 2 hours + so that if I cron it multiple instances will occur. Anyone else run into this problem?

I actually mentioned this somewhere, if not in the instruction, it will be somewhere in this thread.

The script tries to check if there is another instance of script running within 30 minutes from the time the last script was run. It will ignore the checking if it is over 30 minutes and considers the last run crashed.

So it is important not to set up the cron job before the completion of the initial import, as the initial importation may take too much time.

[krohnathlonman]

vB indexes all the words in the post contents, that is why it is very fast to search a term from the post. Whereas a normal news reader usually only index the subject. To find a keyword within the post would basically require a full article scan. I believe the indexing takes up most of the time for importing.

To speed up a bit, one can delete the index for 'msgid' in the post table, and reindex that field with a smaller size. It is quite easy to do with myphpadmin. Just set the size of the index to 10 or 15. That might(according to mysql manual) improve some speed.

Could you give us some more information on this as well as anything else that can speed the import process up... So far I've just been tossing SCSI drives at it and simply waiting LOL

[lierduh]

Could you give us some more information on this as well as anything else that can speed the import process up... So far I've just been tossing SCSI drives at it and simply waiting LOL

To delete the old index:

ALTER TABLE `post` DROP INDEX `msgid`;

and to add a partial index for msgid:

ALTER TABLE `post` ADD INDEX ( `msgid` ( 10 ) ) ;

10 means instead of indexing the whole length of the field (128), we only index the first 10 charactors. This will reduce the size of the index. The full length index is fastest at the time of retrieving, a partial index means the DB engine needs to read more lines at the time of retrieving but needs less work at writing.

To people who needs to import large amount of posts in one go. I think if you disable the index building process at the time of importing, it will speed up a lot. You can then rebuild the index using the AdminCP. Bear in mind, rebuilding the index takes a VERY long time. The total time used to rebuild the index should be less than the time used to import large amount of messages and build the index at the same time. I have not done this, this is only base on the theory that it is very slow to insert records into a fulltext index table, and it is faster to build the fulltext index after all the insertions are done.

If you do not need to search the imported messages, then disabling the index build will surely speed up the import. To do this, just comment out

build_post_index($postid, $foruminfo);

line in the /include/functions_nntp.php

[vprp]

I'm gonna go ahead and test the 3.5 version on my test version. I'll let you all know how things go.

[krohnathlonman]

the 3.5 version works good an does support attachments from the testing I've done....

[flicknut]

I just received this email through my contact form today:

> --------------------------------
>
> ++++ you. ++++ you hardcore.
>
> How DARE you incorporate usenet, and make me participate with your
> website?? You make it look like the threads are started here, and we are
> subject to your rules and regs. I never subscribed here, and you are not
> google, where it is implicit that the Usenet group is being archived. You
> are not attributing the newsgroup, you are
> hijacking our posts that we made in good faith.
>
> Next, if someone violates YOUR guidlines, but their post did not violate
> their isp providers guidelines for Usenet, and that person is "reported"
> to their isp by a participant here...you get my drift?
>
> Lazy, plagerizing, deceitful, unfair...you name it, you lazy bastards, you
> ARE it.
>
> Jerks. May your website be a failure...in fact, I am contacting YOUR ISP
> and webspace provider, and complaining. Expect more from other usnet-only
> users.
>
> --------------------------------

[kmike]

<font size="1">No wonder Usenet has fallen into decline, with such amount of unmotivated hate and zealotry there...</font>

[Deriel]

I'm having a trouble with e-mail subjects with more than 64 characters... the import simply stops everytime. Some idea?

[lierduh]

I'm having a trouble with e-mail subjects with more than 64 characters... the import simply stops everytime. Some idea?

Please provide more information.

[lierduh]

I just received this email through my contact form today:

> --------------------------------

This is not the first, and will not be the last.

Generally forums should not advertise the forums throught the gateway. Even the linked thread URLs can be considered advertising, so I turn all the footers off, only leave the username to be sent with the message. Also the forum owner should educate their users about what the gateway is. Failing that, making the USENET forums as moderated forums may be the way to go.

Edit: the newer version I am working on (not uploaded, only used in my board and in the cvs) tags all the imported user names with Ext User(usenet user name). So it will be more clear for the origin of the USENET messages.

BTW, new features will only be added to the version vb3_5 branch. vb3_5 branch is the newer version to work with vB3.5.

[Deriel]

Please provide more information.

I'll try to :think:

Here are the complete header of a message that cannot be imported. Pro process stop and resume only after I delete the message. I using the Hack in a Message List, not Usenet


Return-Path: <sentto-2458507-36227-1120444200-teste_nf_listas=valinor.com.br@returns.groups.yaho o.com>
Delivered-To: teste_nf_listas@valinor.com.br
Received: (qmail 86047 invoked by uid 1011); 4 Jul 2005 02:31:54 -0000
Received: from n24.bulk.scd.yahoo.com (66.94.237.53)
by laurelin.valinor.com.br with SMTP; 4 Jul 2005 02:31:54 -0000
Comment: DomainKeys? See http://antispam.yahoo.com/domainkeys
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=hotel; d=yahoogrupos.com.br;
b=Txb9pQq7e04HAMjz1k2ereT0zmw7cpDSFRmC7lylF4H2w7ZF s7Ad6dvgUhH1scIbXEWY+ChnCTc5g0cxyFZNPv+iNHwdXm6fuv xx6DYw2ev5Lw++ZL5ycIriBhUk6Y7H;
Received: from [66.218.66.59] by n24.bulk.scd.yahoo.com with NNFMP; 04 Jul 2005 02:30:00 -0000
Received: from [66.218.66.27] by mailer8.bulk.scd.yahoo.com with NNFMP; 04 Jul 2005 02:30:00 -0000
X-Yahoo-Newman-Property: groups-email
X-Sender: lordpas@yahoo.com.br
X-Apparently-To: valinor_br@yahoogrupos.com.br
Received: (qmail 28172 invoked from network); 4 Jul 2005 02:29:59 -0000
Received: from unknown (66.218.66.218)
by m21.grp.scd.yahoo.com with QMQP; 4 Jul 2005 02:29:59 -0000
Received: from unknown (HELO n31.bulk.scd.yahoo.com) (66.94.237.60)
by mta3.grp.scd.yahoo.com with SMTP; 4 Jul 2005 02:29:59 -0000
Comment: DomainKeys? See http://antispam.yahoo.com/domainkeys
Received: from [66.218.69.1] by n31.bulk.scd.yahoo.com with NNFMP; 04 Jul 2005 02:29:55 -0000
Received: from [66.218.66.65] by mailer1.bulk.scd.yahoo.com with NNFMP; 04 Jul 2005 02:29:55 -0000
To: valinor_br@yahoogrupos.com.br
Message-ID: <daa6v0+u0re@eGroups.com>
In-Reply-To: <20050703180435.95520.qmail@web80902.mail.scd.yahoo .com>
User-Agent: eGroups-EW/0.82
X-Mailer: Yahoo Groups Message Poster
X-Originating-IP: 66.94.237.60
X-eGroups-Msg-Info: 1:12:0
X-Yahoo-Post-IP: 200.102.98.75
From: "lordpas" <lordpas@yahoo.com.br>
X-Yahoo-Profile: lordpas
Sender: valinor_br@yahoogrupos.com.br
MIME-Version: 1.0
Mailing-List: list valinor_br@yahoogrupos.com.br; contact valinor_br-owner@yahoogrupos.com.br
Delivered-To: mailing list valinor_br@yahoogrupos.com.br
List-Id: <valinor_br.yahoogrupos.com.br>
Precedence: bulk
List-Unsubscribe: <mailto:valinor_br-unsubscribe@yahoogrupos.com.br>
Date: Mon, 04 Jul 2005 02:29:52 -0000
Subject: =?iso-8859-1?q?Re:_[VALINOR]_Diferen=E7as_entre_esp=EDritos_elficos_e_humanos. ?=
Reply-To: valinor_br@yahoogrupos.com.br
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

The message subject is Re: [VALINOR] Diferen?as entre esp?ritos elficos e humanos. and its body is




Se Luthien volta como mulher, como diz o Silma, n?o existe raz?o
para Dior ser meio elfo.


Mas eu sei que existem fontes que o citam assim. ? nessas horas que
eu queria um help do Boss, j? que ele parece saber sobre Dior, etc...

E claro, os descendentes de Dior no caso s?o meio elfos por causa
dos tchaca-tchacas que ocorreram entre Idril e Tuor, Earendil e
Elwing, etc... N?o existe a real necessidade DELE ser meio elfo pra
explicar alguma coisa.

E Tolkien ainda me mata o rapaz antes da hora, gasp... s? pra
ficarmos na d?vida sobre at? quando ele teria vivido, etc... bem
apagadinho esse Dior tamb?m. Nem parece filho de Luthien & Beren.

Lordpas

--- Em valinor_br@yahoogrupos.com.br, ghostty2001 <ghostty2001@y...>
escreveu
> Lord, eu acredito que Dior seja meio elfo, pois
> Luthien era elfa na verdade, apenas ganha a chance de
> voltar como mortal para poder viver o seu amor por
> Beren em paz. Mas ? apenas algo que eu acho que possa
> ser uma resposta convincente!!
>
> ghostty
>
>




PARA SAIR DA LISTA basta enviar um e-mail *a partir do e-mail que est? cadastrado na
lista* para valinor_br-unsubscribe@yahoogroups.com

GUIA DE COMO SE CADASTRAR NO YAHOOGRUPOS
http://www.valinor.com.br/artigos/artigo.asp?id=454

PARTICIPE TAMB?M DA VALINOR_FILMES:
http://br.groups.yahoo.com/group/valinor_filmes

PARTICIPE TAMB?M DO NEWSLETTER_VALINOR:
http://br.groups.yahoo.com/group/valinor_newsletter

PARTICIPE TAMB?M DO FORUM VALINOR:
http://forum.valinor.com.br
Links do Yahoo! Grupos

<*> Para visitar o site do seu grupo na web, acesse:
http://br.groups.yahoo.com/group/valinor_br/

<*> Para sair deste grupo, envie um e-mail para:
valinor_br-unsubscribe@yahoogrupos.com.br

<*> O uso que voc? faz do Yahoo! Grupos est? sujeito aos:
http://br.yahoo.com/info/utos.html


What another informations should I send?

[lierduh]

What another informations should I send?

A debug log will centainly help.

I imported that message without any problem.

I notice the subject is mime coded.
Does your php server have "imap_mime_header_decode" function?

[Deriel]

A debug log will centainly help.

I imported that message without any problem.

I notice the subject is mime coded.
Does your php server have "imap_mime_header_decode" function?

I put a serie of "print" to investigate and the processing stops in these lines:

logging("Getting message number $current: ");
$last_loaded = $current;
$mime = new mime();

[Deriel]

Another problem. The title match method isn't working ok, like in

http://forum.valinor.com.br/forumdisplay.php?f=86

The is a thread for every mail reply

[Gutspiller]

Does this work with 3.0.7?

[lierduh]

Does this work with 3.0.7?

3.07 is the same as 3.05 other than some minor security patchies

[lierduh]

Another problem. The title match method isn't working ok, like in

http://forum.valinor.com.br/forumdisplay.php?f=86

The is a thread for every mail reply

You need to go through the settings again, there is a setting to deal with this.

[lierduh]

I put a serie of "print" to investigate and the processing stops in these lines:

logging("Getting message number $current: ");
$last_loaded = $current;
$mime = new mime();


When I say debug, I meant to run the gateway in debug mode. Please see readme.txt

[Gutspiller]

I'm new to this. What do I put in the "Newsgroup/Mailing list E-mail" and "Server" text fields when setting it up to pull a newsgroup?

The newsgroup I want to use is alt.games.video.xbox what do I need to put into the fields when creating the new newsgroup??? :(

[Gutspiller]

bump

[krohnathlonman]

anybody come up with a way to bypass having so many duplicate posts? the only thing I've come up with so far is runnig the import then using the vbulletin tool to kill dupe threads

[Gutspiller]

I'm new to this. What do I put in the "Newsgroup/Mailing list E-mail" and "Server" text fields when setting it up to pull a newsgroup?

The newsgroup I want to use is alt.games.video.xbox what do I need to put into the fields when creating the new newsgroup??? :(
bump

[mpascal]

I am picking up POP mail and when I run the gateway.php I get the following error:


Database error in vBulletin 3.0.7:

Invalid SQL:
SELECT post.*, thread.*,
post.dateline AS postdateline, post.msgid AS postmsgid,
thread.title AS threadtitle, post.visible AS postvisible,
thread.visible AS threadvisible
FROM vb_post as post LEFT JOIN vb_thread as thread
ON (thread.threadid = post.threadid
AND post.userid = thread.postuserid
AND post.postid = thread.firstpostid)
WHERE post.isusenetpost = 0
AND post.postid > 49509
AND thread.forumid = 32

mysql error: Unknown column 'post.msgid' in 'field list'

mysql error number: 1054



I do not have msgid column and all my tables have a prefix "vb_post" not "post"

What am I doing wrong?

[Gutspiller]

I'm new to this. What do I put in the "Newsgroup/Mailing list E-mail" and "Server" text fields when setting it up to pull a newsgroup?

The newsgroup I want to use is alt.games.video.xbox what do I need to put into the fields when creating the new newsgroup??? :(

Come on people! I took the time to install this mod, the least somebody could do is help me on how I fill in the info boxes to get it to pull the content it's suppose to.. :disappointed:

[SEO Report]

Newsgroup/Mailing list E-mail = the name of the newsgroup you want to import (that would be alt.games.video.xbox)

Server = the name of your nntp provider (ie. news.blabla.com)

HTH,
-k

[sanereddy]

Hello All,

Could some one help me how to remove or replace the '=?Utf-8?B?UmFqYQ==?= ' in teh place of user name .. tried to find the answer in the forum, I could not find it.. I am sorry if it's answered. Could you please give me the link how we can replace that with guyest or something...

Regards,

[sdsvtdriver]

Come on people! I took the time to install this mod, the least somebody could do is help me on how I fill in the info boxes to get it to pull the content it's suppose to.. :disappointed:

you need to subscribe to a Usenet server service for best results.

Giganews, Usenetserver, etc

you can use your local ISP's but they tend to have little retention. Regardless of which you use, they'll provide you with the proper information.

[sanereddy]

Hello sdsvtdriver,

Do you know how I can remove those junk user id's.....

Can I use giganes on the forum without any reststrcitions?

Thanks,

[blist]

What are the recommended settings for a read-only setup, on a mailing list for example?

[TMM-TT]

I'm not sure if this has been discussed before, but I have experienced some problems with Xrefs and messages that has been crossposted. It seems like the importer only looks for the first xref (or something like that) in the header, so if there's crossposts the import stops completely and I have to update the postcount manually for those groups. Is that a known problem or something that only I have seen?

[sensimilla]

great hack ! thanks

[frakman]

(CUT silly first message about how to get pop3 working)
amazing the difference some sleep makes.

Ok - I know somewhere in this thread is "mbox" but I cannot find it.

I have a 10k message mbox extracted from Yahoo. Is there a way of importing that directly into the system - other than copying the file to a POP3 mail folder and getting via POP3?

Cheers,
Mathew

[Gutspiller]

Newsgroup/Mailing list E-mail = the name of the newsgroup you want to import (that would be alt.games.video.xbox)

Server = the name of your nntp provider (ie. news.blabla.com)

HTH,
-k

How do we find out who is our "nntp provider "? Is this something you have to pay for or is there a question I should ask my host to find this out? Something that is setup on my server or what?

[DefenceTalk]

I am getting 404 errors when trying to run

gateway.php?debug=1

Any idea why?

thanks

[eljeffe]

I've waded through the replies in this thread, and I still have a few questions.

We are looking for a hack that allows our members to participate via email. Receive posts via email, make posts via email, and reply to posts via email. We have a email server that has mailing list capabilities, but I'd like to understand more about how this feature works. There is TONS of information on how to interact with usenet via NNTP, but I do not find much information on how to interact with mailing lists and allow our members to treat the vBulletin forums like they do with a Yahoo Groups or other email list based community.

If anyone has implemented this hack in the manner I described above, please reply or send me a PM with some of your experiences.

Thanks

[lamilein]

a GREAT release, thank you :)

[observer]

I installed everything (latest version) and have the following problem:

When I want to run gateway.php?debug=1, it tells me that another instance is already running. No posts are imported.

So - where's my error?

[netearth]

Hi there

Like the patch! Quick question though, is there anyway that in the settings of the "Edit Newsgroup Settings" that the Prefix could have a wildcard? REason for asking is that I have a email list that I subscribe to, and their subject line is [abc e:01234] kind oif thing, the first part is always the same abc e: but the number changes!!

Or as teh header of the email has a Reply to address of the list, can that be set anywhere so as to stop spam from entering the thread!?!?!?

Thanks,
Chris

[John Diver]

Hey,
Can someone help please.

This is the first time I am trying to use anything like this.

I want to add the messages from alt.politics.bush to my forum.
Can someone tell me if I can do this and help please?

I am getting the following error:

Not connected
Not connected
<html><head><title>Iran War Information Forum Database Error</title><style type="text/css"><!--.error { font: 11px tahoma, verdana, arial, sans-serif; }--></style></head>
<body></table></td></tr></table></form>
<blockquote><p class="error">&nbsp;</p><p class="error"><b>There seems to have been a slight problem with the Iran War Information Forum database.</b><br />
Please try again by pressing the <a href="javascript:window.location=window.location;">refresh</a> button in your browser.</p><p class="error">An E-Mail has been dispatched to our <a href="mailto:tmzmod@hotmail.com">Technical Staff</a>, who you can also contact if the problem persists.</p><p class="error">We apologise for any inconvenience.</p><form><textarea class="error" rows="15" cols="100" wrap="off">Database error in vBulletin 3.0.7:

Invalid SQL: UPDATE nntp_settings
SET value = WHERE varname = 'last_postid'

mysql error: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'WHERE varname = 'last_postid'' at line 2

mysql error number: 1064

Thanks very much

[lierduh]

Hey,
Can someone help please.

This is the first time I am trying to use anything like this.

I want to add the messages from alt.politics.bush to my forum.
Can someone tell me if I can do this and help please?

I am getting the following error:



Thanks very much

You have an empty forum. Make one post and you will be fine.

[John Diver]

Thanks for the quick reply :)

I am still getting not connected:

Gateway version 2.3.2 1 group(s) gatewayed.
Could not connect to NNTP-server. (Connection refused (61))

Not connected
Posting Message 'Description of this forum' from admin. Result:
Not connected
Not connected

[babulgogoi]

Hi,

I could find nothing that does the following changes!!!

can someone pls help me? screenshot attached.

Bg
=======

Newsgroup/M-list E-mail : the email address to send a message to mailing list.
Server: A pop3 email server. One dedicated email address to receive emails from list.
Username: pop3 email user name
Password: pop3 email account password
Sender:
Set to 'use_real_email': will use the member's real email address in the From: header
Set to 'One Name <a_email@a_domain.com>': All posts will use this as the From: header
Leave this empty: posts will use a randomly generated email address to prevent spam
prefix: Set this to the mailing list title. Eg. if the mailing list always have
[Newbie] in the subject line, enter [Newbie] as the prefix. If you leave
this blank, all messages will be imported.
lastmsg: no need to set

[John Diver]

Hey,
I thought the server was meant to be pop3 server?

Then some people said its a newgroup server?

Could someone tell me what should go in there please?

Thanks
John

[babulgogoi]

ok, I got it!! thanks.

[babulgogoi]

while trying to run: http://www.asiasrc.org/posts/gateway.php?debug=1

got this eror

Fatal error: Call to undefined function: globalize() in /home/asiasrc/public_html/posts/gateway.php on line 73

?? any idea??

[lierduh]

while trying to run: http://www.asiasrc.org/posts/gateway.php?debug=1

got this eror

Fatal error: Call to undefined function: globalize() in /home/asiasrc/public_html/posts/gateway.php on line 73

?? any idea??

Don't tell me you are running vB3.5 already. This hack is for vB3.0x.

[babulgogoi]

Oh sorry, i hv not noticed the version..

Well, I think I hv to install 3.0.5 and then install your plugin.

will that work??

PS. r u working on the plugin ofr vb 3.5.0??

[babulgogoi]

I got this error: while accessing gateway.pgp script as per instruction.

Database error in vBulletin 3.0.5:

Invalid SQL: UPDATE vb3_nntp_settings
SET value = WHERE varname = 'last_postid'

mysql error: You have an error in your SQL syntax. Check the manual that corresponds to your MySQL server version for the right syntax to use near 'WHERE varname = 'last_postid'' at line 2

mysql error number: 1064

Date: Monday 10th of October 2005 10:10:58 AM
Script: http://www.asiasrc.org/upload/gateway.php?debug=1
Referer:
Username: Unregistered
IP Address: 210.211.161.85

------

any help??

[KevinM]

I keep having issues with a few usenet users where the posts don't appear to decode correctly, although when I check with a newsreader it works fine.

It starts a new thread and puts 'No Subject' as the subject (which is the default behaviour if the gateway script cannot detect a subject), and puts the complete headers and text into the post (see below)

Any ideas? (I have replaced the email addresses with xxxx)


User-Agent: Mozilla Thunderbird 1.0 (Windows/20041206)
X-Accept-Language: en-us, en
MIME-Version: 1.0
Newsgroups: uk.d-i-y
Subject: Re: B&Q Cable clearance
References: Pg2jENAy5oSDFwEC@y.z 4db7bc0929xxxx@xxxxxxx.co.uk
In-Reply-To: 4db7bc0929xxxx@xxxxxxx.co.uk
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Complaints-To: abuse@clara.net (please include full headers)
X-Trace: 44333900e1e4932e33529800133b032ee332e00482a22388d7 327111434ac292
NNTP-Posting-Date: Mon, 10 Oct 2005 20:35:46 +0100
Message-ID: 1128972946.55394.0@doris.uk.clara.net
Lines: 13
Xref: number1.nntp.dca.giganews.com uk.d-i-y:572578

wrote:
My nearest B&Q warehouse is clearing out reels of old colour
mains cables & tails:
16mm x 25m Earth 8.57
The tails may be cheaper, but not many DIYers would 'stock' these, and a
pro .......

[lierduh]

I keep having issues with a few usenet users where the posts don't appear to decode correctly, although when I check with a newsreader it works fine.

It starts a new thread and puts 'No Subject' as the subject (which is the default behaviour if the gateway script cannot detect a subject), and puts the complete headers and text into the post (see below)

Any ideas? (I have replaced the email addresses with xxxx)

I noticed the post does not contain "From:" header. It is weird as the news server should not have accepted the post as the From: header is a must.

[oldengine]

Everything appears to be working fine, but I did have this error when running nntp_settings.php

Database error in vBulletin 3.0.7: Invalid SQL: ALTER TABLE post ADD ref TEXT NOT NULL mysql error: Duplicate column name 'ref' mysql error number: 1060

I ran it again and all appeared to be fine. I have loaded 665 threads and 3,314 posts from one news group.

This error displayed with the same results on my test forum (different domain, same server) as well as my main forum.

[David_R]

i have a strange issue.
one my forum i am fetching news articles for 5 groups.
i tried adding a 6th group and created a forum properly..

but messages are not getting imported into this newly created forum. can someone tell me why ?
i tried to run gateway.php in debug mode but i am unable to view the output :(

i tried to login to my news provider through telnet, this works absolutely fine.

need help. i cannot fix problem since last 5 days now

[myMigration]

lierduh

Can you or anyone else tell me if its possible to propogate to two newsgroups from one vb forum?

I think it will pull in from two newsgroups but i dont think it will post to the relevant newgroups from internal posts on vb.

I did not want to create an additional forum so i might if its feasable only pull posts in from the two newgroups and not post out.

Can this be done?

Create Hack BTW, i have been tweaking it for months to fit into my site and it is working like a charm.

[lierduh]

Cross posting is not supported.
Cross posting is generally regarded as bad practice by USENET community by the way.

lierduh

Can you or anyone else tell me if its possible to propogate to two newsgroups from one vb forum?

I think it will pull in from two newsgroups but i dont think it will post to the relevant newgroups from internal posts on vb.

I did not want to create an additional forum so i might if its feasable only pull posts in from the two newgroups and not post out.

Can this be done?

Create Hack BTW, i have been tweaking it for months to fit into my site and it is working like a charm.

[lierduh]

i have a strange issue.
one my forum i am fetching news articles for 5 groups.
i tried adding a 6th group and created a forum properly..

but messages are not getting imported into this newly created forum. can someone tell me why ?
i tried to run gateway.php in debug mode but i am unable to view the output :(

i tried to login to my news provider through telnet, this works absolutely fine.

need help. i cannot fix problem since last 5 days now

Should not have this limitation.
What about disable one of two previous groups?

[lierduh]

Everything appears to be working fine, but I did have this error when running nntp_settings.php

Database error in vBulletin 3.0.7: Invalid SQL: ALTER TABLE post ADD ref TEXT NOT NULL mysql error: Duplicate column name 'ref' mysql error number: 1060

I ran it again and all appeared to be fine. I have loaded 665 threads and 3,314 posts from one news group.

This error displayed with the same results on my test forum (different domain, same server) as well as my main forum.

The script tried to add a table field but the table field 'ref' exited already probably due to previous installation.

[oldengine]

The script tried to add a table field but the table field 'ref' exited already probably due to previous installation.
Never heard from it again. The mod has been working flawlessly.

[poliveira]

Any plans to support 3.5? If so, is it possible to share a timetable?

I noticed from the thread that many are already running 3.5, will this mod work on 3.5?

Thanks

[Krisekocm]

Yes it is

[poliveira]

Thanks for the quick reply, but can you clarify?
It is planned or currently works on 3.5
Thanks

[Krisekocm]

how to make this working tu update more then one group ! ?

[Krisekocm]

<b>Fatal error</b>: Maximum execution time of 30 seconds exceeded in <b>/home/ocm/site/vhost/forum/includes/class_core.php</b> on line <b>2931</b><br />

[scottct1]

Anyone got this running on vb3.5.3?

I tried installing it and whenever I run the admin functions I get an error message.

Fatal error: Call to a member function on a non-object in /home/satellit/public_html/admincp/nntp_settings.php on line 48

[thedvs]

@scottct1 you need to use this version for 3.5.3...

https://vborg.vbsupport.ru/showthread.php?t=92588

[David_R]

Should not have this limitation.
What about disable one of two previous groups?

tried every possibility i could imagine, but still wont work for any new forum added :(
i am trying to add a new forum fetching news posts from a new newsgroup..

dunt know what is wrong

[jarosciak]

Ok, somehow I got it to work.
Problem now is that it will grab 10-15 posts in like 5 seconds and then it stops, refreshes the page and displays:

Another instance of gateway.php is running, try again in 30 minutes if the script was crashed.

Anyone else had this problem and can help?

Joe

[tpearl5]

I have no idea why, but all a suddent I've been getting this error message on gateway:
Could not connect to NNTP-server. (Connection timed out (110))

I use newshosting and just tried giganews. Getting the same errors. What could be causing this? I can login fine using a regular news reader.

[anonscape]

Is anyone using this great mod with a free usenet service? I notice that several peple are using the paid for service at Giganews but is there a free news provider that would work ok with this hack?

TIA for your help.

[TMM-TT]

Is anyone using this great mod with a free usenet service? I notice that several peple are using the paid for service at Giganews but is there a free news provider that would work ok with this hack?

TIA for your help.
If you're still interested you can send me a PM, so I can set up a testingaccount for you at news.tornevall.net

[vol_freak]

anyone running this with 3.6 yet?

[woodp]

Ignore this post, I'm running vB3.6.4 and shouldn't have posted here.

[kjhkjh]

ok if someone could help and forgive my ignorance on this then i'd appreciate it.

I have installed the hack and have changed the settings in the admincp for the newsgroups. the bit that I'm stuck on is the server for the nntp.

Now say that I have a usenet group that i want to connect to "alt.uk.------"

What do I put in as the server. The example given in the readme is msnews.microsoft.com but surely it has to be something relevant to the alt.uk.----- group?

Do I have to find this from the person who started this usenet group?
Do I have to ask their permission to connect my vb forum to them?
Is the server value from them or a third party?
Is this something that I'll have to pay for?

Thanks for any help. I'm a complete beginner to this and so appreciate any help.

:surprised:

[Sanjiyan]

The server option refers to the USENET or NNTP server address.

Normally your ISP will have a newsgroup/usenet/nntp server for example my ISK Blueyonder, has a newsgroup server at the address: news.blueyonder.co.uk

If your ISP does not have a newsgroup server, then there are plenty of free servers on the internet, google for one. If that does not work then there are newgroup servers ran by commercial companys that charge for access to them.

You would put that server address into the server field.
You would put the newgroup such as rec.arts.anime.creative into the newsgroup/mailing list email.

See the attached .jpg for reference.

[kjhkjh]

Thanks Sanjiyan,

I have tried looking for free nntp servers that I could use, but it really isn't that easy. When I start reading through their terms it becomes clear that linking to a vbulletin forum to pull and post messages isn't allowed.

I couldn't find any settings to put in for google either (although I regularly use the web to view usenet through google groups).

Can anyone tell me the settings for a free nntp server that would allow me to pull and post messages to and from my VB forum?

If I have to pay, can anyone recommend a server that is excellent value for use with vb?

Are there any pitfalls or things that I should think about when signing up with a commercial service?

Thanks.

[kjhkjh]

I have just taken a look at Giganews.

Even paying for service with them seems to open the door to potential problems. Say that someone spams in my forum and this ends up on usenet through Giganews' service:

If it is determined that you have posted spam through the Giganews servers, you will be charged a $50 cleanup fee per spam message that you posted, and your account will be terminated.

That could end up pretty pricey.

What is the way around this. What NNTP servers are people currently using this hack with?

Thanks.

[Sanjiyan]

I have just taken a look at Giganews.

Even paying for service with them seems to open the door to potential problems. Say that someone spams in my forum and this ends up on usenet through Giganews' service:



That could end up pretty pricey.

What is the way around this. What NNTP servers are people currently using this hack with?

Thanks.

You can do what I have done.

The forums that the nttp script uses on my site, are locked from anyone posting to them, as such the script puts posts into a locked forum, the registered users can not reply to them.

Another way of stopping them is via the nntp script settings under the admincp system.

It is called:

Send message to USENET
Default: 1. Set it to 0 if you do not want to send your local posts to the USENET

I have mine set to 0. So even if a user finds away of posting, the reply or post stays local to the forums, its not forwarded onto the news server.

As for a free news server, if your in the UK, then Blueyonder (www.blueyonder.co.uk) have one just search their site for usenet or newsgroup, also check your ISP, 99.999% of all UK based ISPs have some sort of news server they offer as part of the package.

[kjhkjh]

Thanks Sanjiyan,

I think that I will do that. Just make posts get pulled from USENET and not have forum members posts go to usenet.

I don't really want to lock forums though.

I'm having another problem now.

Have signed up with tigernewsnet.com ($7.50 a month) I have the server, username and password details.

Now when I plug these into outlook, it downloads the usenet groups I visit - so it works there.

But when I plug these details into the admincp usenet options, I get the following error:

Gateway version 2.3.2 1 group(s) gatewayed.
Could not connect to NNTP-server. (Permission denied (13))

Not connected
Not connected

I'm not sure why permission is getting denied and whether it has anything to do with my website host, or if it is the nntp host - although I doubt this because outlook is pulling threads with the settings...

[kjhkjh]

Can anyone help me with this error I described last post?

Gateway version 2.3.2 1 group(s) gatewayed.
Could not connect to NNTP-server. (Permission denied (13))

Not connected
Not connected

As mentionned all the settings work with outlook (sucking in groups with the tigernews settings) but I get the above error when I run the debug url.

Do I need to get my website host to open certain ports?

Any help really really appreciated. I'm spending too much time on my forum site at the moment!

Thanks

[amaarvell]

hi
i just installed this and it says its gatewayed but no posts are coming through
any ideas

and in english please as i am a newbie

[b00k]

Gateway version 2.3.2 3 group(s) gatewayed.

Connecting to server, server says: 200 News.GigaNews.Com
Server responded after user name: 381 more authentication required
Server responded after password: 281 News.GigaNews.Com
Info for rec.123.123 at news.giganews.com: 211 57025 604644 661668 rec.123.123
Could not connect to NNTP-server. ( (-1213239480))
Not connected
Not connected
Could not connect to NNTP-server. ( (-1213239480))
Not connected
Not connected

i get that through debug mode. Originally it worked flawless and dumped in 100K posts over the course of a few days.

For some reason it has come to a stand still, a dramatic one.

I had added a few more areas, then disabled them. So now i have 2 populated feed areas and 1 empty. I have added 1 post to that area.

Any advice ?

[b00k]

anyone ? :o

[DonMecca]

Does this still work?

[Odoin]

Works in 3.6.0 for me, to scared to upgrade to 3.6.8 :-s.

Mark

[DonMecca]

Works in 3.6.0 for me, to scared to upgrade to 3.6.8 :-s.

Mark


Unfortunately I don/t have access to 3.6 version since I'm new to vB. Hmnn Could I install 3.6 then use this script then upgrade to the latest version? ...

Anyone here using the lastest vB version and has this installed ?

[ryancooper]

Is it normal for it to take hours to populate on the first run? It is going really slow for me?