PDA

View Full Version : NNTP Newsgroups Importing


peterska2
07-04-2008, 01:38 AM
I'm currently using the older NNTP mod found here:
https://vborg.vbsupport.ru/showthread.php?t=92588

However, it doesn't really work correctly with vBulletin 3.7 (it imports but doesn't export) so I am looking for an updated version with the following features:


Imports newsgroup content to forum
Exports forum created content back to newsgroup
Admin option to allow newsgroup users to be registered users on your forums by auto creating accounts using the username and email address passed from the newsgroupI don't currently have the time do go through the older code and do the required updates to it to add these functions in a 3.7 compatible manner.

While this is a free request, if done well and works how I want it to work then there is a possibility of a small donation or a link to be placed on my sites network pages (pages with links to all the sites in my network and selected other sites where link exchanges have been negotiated) by way of thanks. There is no guarantee of this though, as it depends on how closely it matches my requirements.

peterska2
07-10-2008, 06:09 PM
Any takers?

Dylanblitz
07-14-2008, 06:02 AM
I'm currently using the older NNTP mod found here:
https://vborg.vbsupport.ru/showthread.php?t=92588

However, it doesn't really work correctly with vBulletin 3.7 (it imports but doesn't export) so I am looking for an updated version with the following features:


Imports newsgroup content to forum
Exports forum created content back to newsgroup
Admin option to allow newsgroup users to be registered users on your forums by auto creating accounts using the username and email address passed from the newsgroupI don't currently have the time do go through the older code and do the required updates to it to add these functions in a 3.7 compatible manner.

While this is a free request, if done well and works how I want it to work then there is a possibility of a small donation or a link to be placed on my sites network pages (pages with links to all the sites in my network and selected other sites where link exchanges have been negotiated) by way of thanks. There is no guarantee of this though, as it depends on how closely it matches my requirements.

I set it up and it would post back to the news group for me?

t3nt3tion
07-16-2008, 12:52 AM
Well, the mod does work for me ok in standard form, but I`m tweaking it to allow more than 1 instance for importing binaries. Currently it works ok, but it`s vulnerable to sudden mysql restarts, and there is no real protection to that, just to reset the workers. I`ve pretty much downloaded the v3.5 of the current NNTP mod, and just started tweaking it, removing bugs as I go along.

PS. I also have on my agenda a future upgrade of the NNTP class, since it was primarily built for php v4.

tpearl5
08-14-2008, 12:55 PM
Anyone make any progress on this?

t3nt3tion
08-14-2008, 01:01 PM
Depends on what you`re referring to "progress"

tpearl5
08-14-2008, 01:14 PM
Bug cleanup and getting things to work properly for 3.7. Right now it doesn't seem to be exporting and I get a lot of duplicate threads because it is not posting replies correctly.

t3nt3tion
08-14-2008, 01:21 PM
well, I`m only using to import, and have customized it a bit to import more, so it stresses the server a bit more. I`ll probably need to take a look on the importer. Thing is, this script is using an old pear class.

Mum
08-20-2008, 07:32 PM
I'd love an updated version for 3.7 too :)

berben4
09-19-2008, 11:57 AM
I would also be interested in getting this up to speed. I really need it to download from binary groups and display the pictures as attachments. So far I have been unable to get this to work.

Rik Brown
12-12-2008, 11:09 AM
I'm very interested in any update of this. But I must mention its working flawless for us (we applied all patches back several years ago) even with vb 3.8.0 beta. However, we are not involved with binaries -- just messaging.

If this is ever updated, I'd sure would like to add some suggestions and would be willing to pay for a commercial product.

Regards. -- Rik

t3nt3tion
12-16-2008, 07:10 PM
I`d release my changed mod, but currently there`s code everywhere, no real structure. You`d need to get your hands dirty :D

Rik Brown
12-17-2008, 03:52 PM
I`d release my changed mod, but currently there`s code everywhere, no real structure. You`d need to get your hands dirty :D

That sounds nice. Perhaps all of us using the mod could start a FYI thread for "mods of the mod" which would be totally unsupported -- just attach it to a post and say here it is and no support whatsoever. Then perhaps it would be easier for anyone to assemble all the improvements/fixes into an unsupported but improved version someday.

Right now, I'm concentrating more on running a series of mysql queries to post-process the already imported messages to remove spam and junk plus clean up the looks of the messages and make them look less like Usenet and more like vBulletin.

My biggest concern with the mod (as it now stands) is how slow it is importing old messages. Our host company appears to place anything about 6 months prior on older servers with slower hard drives. It can take days to import a large newsgroup (although the last six months imports in minutes).

Anyway, if Kerry-Anne is also listening (and to keep on topic), I'm sure many of us that have made changes over the years could send her changes that she might be able to easily incorporate into her release?

Cheers! -- Rik

t3nt3tion
12-17-2008, 04:04 PM
I might do that, but currently the problem with this mod that I have is that it`s really done live on the server. No real structure etc .. without some coding knowledge and some vbulletin knowledge, you wouldn`t understand how to work it.
The slow importing could be due to the fact that it uses an old nntp import class ( 2004 ), and since then there were several updates ( latest version is from 2008 ).
My version is still on 2004, but I added some instances ( so it can import into max 10 boards at one time - even more if you add more instances to the sql ).
I`ll work in updating this, but currently, since it`s not bringing in $$, I`m not putting it in first place.

t3nt3tion
12-26-2008, 08:01 PM
I`ll probably get in touch after new year`s eve.

James T Brock
01-09-2009, 08:52 AM
Can anyone get this done for 3.8?

Mum
01-12-2009, 05:32 PM
I'm waiting for it too!

t3nt3tion
01-26-2009, 08:40 PM
That is something, thanks for the generous offer.
I`m curious, what features are people interested in.
As far as I`ve come till now this is what I managed to do :

My version
- instance conversion from the base 1 forum import mode ( basically, you can add instances and you`ll have more than 1 importer running at a time )
- fixed improper thread /post insert
- added a custom module that I modified from vb.org to mass add forums
- added fast fill option ( if you add new forums, the importer will fill those first )

To do so far on my list in order:
1. new nntp protocol implementation ( better OOP )
2. antispam
3. I`m thinking of extending the mass add forums to a mass add forums+newsgroups(+pass if diff from the main logins, so you can use multiple accounts )
4. fix user posting ( so you can post on newsgroups as well )

If we could move this to the paid/donate section, I`d gladly make time for this.

bigtime
01-29-2009, 08:25 AM
Hope a 3.8 version gets released! Thanks.

Marco van Herwaarden
01-29-2009, 09:38 AM
Please do not offer payments. If you want to offer payment for a modification, please post in Requests For Paid Services (https://vborg.vbsupport.ru/forumdisplay.php?f=30)

Simon Lloyd
03-09-2009, 11:44 AM
Hi, i currently use this mod on vb3.8.1 with no issues, however my server has just been upgraded from php5 to php 5.2.9 and i now seem to be experiencing database errors everytime the sciprt runs, anyone know how to make it compatible with the latest php?

Marco van Herwaarden
03-09-2009, 12:15 PM
If you have questions/problems with a modification or style, then please post in the thread (or support forum/board) about that modification/style. Best chance to receive a reply from either the author or another member using the same modification/style.

Simon Lloyd
03-09-2009, 03:06 PM
Marco, my apologies, i posted here as the author hasn't been online since october last year and it seems the discussion for taking this mod forward or working out bugs was here. :)

Marco van Herwaarden
03-09-2009, 03:15 PM
We prefer such a discussion to take place in the modfication thread. Most info would be avaialble there already, most chance to have another user of the same modification see your question and know the answer, and all Q&A regarding a modification are located in a single thread instead of spread all over the boards.

tommeyboy
03-14-2009, 04:30 PM
Any updates on this? I'd like to get this implemented on one of my forums.

Arkham
03-24-2009, 04:23 PM
Ditto -- this is something I've always wanted to install when I get my system up. Hopefully someone will be able to make the required changes, or take over the project going forward.

Maybe we should all start up a collection? ;)

Simon Lloyd
03-24-2009, 04:30 PM
It doesn't seem to function too well with php 5.2.9, it causes database erros which seem to be related to wait_timeout