I can't seem to get the UUEncoded messages parsed out to be added as attachments. I get a bunch of garbage posts of random strings. I would also like a way to skip over certain file types when scanning for new messages, such as I don't really want to be importing from the alt.binaries_____ groups EVERYTHING that's on them.

Is there some way to do this? Your "Features" says it handles UUEncoded messages, however, I can't find any documentation on this feature anywhere, nor can I get it to decode the messages.

Any help with this is greatly appreciated.

Thanks in advance.

do_chron_log is on (set to "1").

Changed the "Newsgroup/Mailing list E-mail" for the group to my personal e-mail address.

Ran the gateway in debug mode (http://(my domain)/forums/gateway.php?debug=1).

Nothing was sent to my personal e-mail address. The NNTP gateway debug message that was e-mailed to the forum administration address just read:

That's the entire message. Same as before. Nothing else. :(

Here's the SMTP settings on the PHP server.

Again, that's all that's there.

This may be silly, but have you made a new post in that forum before you ran the gateway in debug mode?

Thumbnail creation needs work.
UUEncode is supported. Are you sure the attachment is UUEncoded? Please post a sample of the attachment header and what was imported.

No, I'm not 100% sure it's UUEncoded. It could be a MIME type also. It's just a bunch of garbage characters that the post is like a mile long. I would give you the URL, but a certain word in my URL is censored here. So, let me go dig up a portion of the thread I'm referring to so you can see.

Yes, I did. In fact, I'll do it again. Watch.

8:18 PM
http://www.cyburbia.org/tmp/1.jpg

8:20 PM
https://vborg.vbsupport.ru/

8:22 PM
http://www.cyburbia.org/tmp/3.jpg

8:23 PM
http://www.cyburbia.org/tmp/4.jpg

8:24 PM
https://vborg.vbsupport.ru/

That's it. Nothing about sending messages. No errors. That's all there is. Really.

No e-mail recieved at the NNTP/list address, either. Really.

Ok, please post all your NNTP_settings. Mark out the ones you don't want to show.

Ok, I think I have it partially figured out re: attachments... But I'm getting this debug message, and have set everything to allow attachments...

Getting message number 971197:
This forum does not allow attachments, therefore attachment ignored.

Any idea for what I might be missing?

There are no NNTP settings shown in the PHP information. Here's everything from NNTP Gateway settings, if you mean that.

Organization organization Cyburbia Forums gateway [Edit]
User Agent useragent vBulletin USENET gateway
View profile URL profileurl http://www.(domain)/forums/member.php [Edit]
http://www.(domain)/forums/showthread.php?t= [Edit]
Email address domain email cyburbia.org [Edit]
Make TinyURL at Length tinyurl 70 [Edit]
View attachment URL attachmenturl http://www.(domain)/forums/attachment.php?attachmentid=
Honour No-Archive honor_no-archive 1 [Edit]
is_running 0 [Edit]
Last Max postid last_postid 243556 [Edit]
Last Time Run last_run 1123207512 [Edit]
Send no signature nosignature 0 [Edit]
Send no footer nofooter 0 [Edit]
No Organization Check organization_check 1 [Edit]
Use Post Time use_post_time 0 [Edit]
Skip attachments no_attach 0 [Edit]
Pause Between messages pause_seconds 0 [Edit]
Send message to USENET send_message 0 [Edit]
Default Footer default_footer [Edit]
Strip Footer strip_footer [Edit]
Find Thread by Subject thread_by_subject 1 [Edit]
Global Killfile killfile_setting [Edit]
Generate Debug Message do_cron_log 0

(I reset that last one, so I stop getting logs.)

Can't believe you have not checked/tried this.

Change this to 1 !!!

The attachment is not fully working at the moment, please wait for next release.

Believe it.

I said I had it at 1 before! I said I turned it back to "0" because I didn't want to keep having empty logs e-mailed to me (and all the forum admins/mods who read the forum e-mail address) every hour.

Lemme' show you again ...

https://vborg.vbsupport.ru/

See? do_cron_log 1 And what was the result? I'll show it again.

https://vborg.vbsupport.ru/

I swear on a stack of Bibles, Korans, and Torah scrolls that's all I'm getting.

I have done everything precisely as you have said, and I still get minimal logs, and no outgoing e-mail. Sorry, but it's not working. I give up.

I give up.:(

Go through the Settings and Re-Read my post.

You have

Send message to USENET send_message 0

You need to set it to bloody 1 to send any messages out!!! :)

It is things like this makes me giving up giving more support.

We are talking about hacking here. The users can't even bother to go through the settings properly, let alone to wade through the codes to find the problem. No wondering the hackers either start to charge for their effort or just giving up release hacks.

Some may say you don't know php. Hell, when I used Matt Wright's WWWboard in 96, I did not know anything about perl. I still don't know anything about perl, but I went through the codes and used common sense to get it to work the way I wanted. I am not php programmer either, for the record, I am a business man. I bought myself "Teach Youself PHP in 24 hours" book and learn the rest from internet. When I need to re-code the gateway, I still rely heavily on manual even for simple syntax.

Come on, give more efforts if you consider yourself a hacker.

My stupid. Lemme' try that.

I'd like to make a suggestion... Would it be possible to add a feature when you get the attachment portion working properly, to be able to store the images locally or in the database? That way, it can pull images and put them in a local folder, and add the [img] tag if used locally, as opposed to putting a load on the database.

Just a suggestion, I could be wrong in this.

Whee! It works!

I know what confused me - "Send message to USENET". Since the extension works for mailing lists, you might want to change the wording.

Thanks!

is this worth installing? Looks good, but will it work on rc2 and is it easy to reinstall after each vb update?

Very easy to install since no vb files are edited.

Hi together,

I've got a little tricky question for those NNTP Gateway experts out there :)

As you can see on the first attached screenshot (guests_on_forumdisplay.gif), the username is displayed in the "Last Post" column of forumdisplay.php. Those guys in the example are only "guest posters" from usenet but as you can see, everyone is displayed by his original username.

When we now head up to the next screenshot (guests_on_threaded_view.gif), we look inside an imported usenet thread, where the Threaded Mode feature of vBulletin is active. There you can see, that all guys are named "Newsgroup poster" (that's my alias for the usergroup guest).

I think it would be much better, if the naming of the authors in the Threaded / Hybrid mode box was the same as in forumdisplay.php - everyone, no matter if guest or registered member, should be displayed by his original, individual username. Does anyone have an idea how to achieve that?

Big thanks in advance & keep up the fabulous work! ;)

- Dominik

I've got what's probably a silly question, but after doing some reading and searches, haven't been able to find an answer or solution.

My forum defaults to linear, and 99% of my users stick with that. Does anyone know of a way where I can make a forum (the ones using this hack) default to threaded or hybrid mode for all users?

The next version has the Ext User Prefix with all the messages imported. That would probably help people who are in your position wanting to distinguish internal posts and external posts.

You can see the samples:

http://phorums.com.au/forumdisplay.php?f=21

That is global/user setting, not by Forums. However it will be quite easy to implemented this as a hack through Plugin system. I will include this in the next version.

Wonderful. Thanks for the quick response.

I have this running on a test forum right now, sort of staging everything for my production move to 3.5.0. Anyway, after some feedback with my mods and admins, there's concern about the overwhelming volume of one of the newsgroups (alt.sport.football.college) we want to offer a gateway to.

Is there an option, or could there be an option, for imported threads/posts from offsite *not* to be counted towards the forum totals? So that forum post/thread totals are representative of local user contributions alone. For example, my little testing/staging forum is 2 days old, and has 80 or so local posts on it between myself, and my staff. But just one of the newsgroups has brought in over 7k posts in the same amount of time, thus skewing (severely) the impressions offered by post and thread totals throughout the site. Would be great if we had the ability to clean that up as described. 7k posts is a drop in the well when I move this over to my production side. But even over there, over the course of a year, this could add up very quickly.

Also, is a pruning option feasible? I seem to recall this came up elsewhere in the thread, but if it was, I just missed it browsing back through. I would love to see the option of making imported threads 'decay' after X days, and/or the option to limit the number of posts in one of the forums to Y, where everything older falls off. Either way, with the option (ideally) to make threads that local users have participated in exempt, for the sake of maintaining a relevant and meaningful history.

Just tossing these things out there. The extension is outstanding as-is, and my staff is ecstatic about it. Thanks so much for putting it together, and offering the support you do.

hm. anyone know if its possible to use google usenets? if so, the settings would be? thanks.

Update - with Yahoo Groups, the gateway seems to be working flawlessly. The update from RC 1 to RC 2 didn't affect anything. I don't have a report on threading yet, since all the recent posts on the Yahoo group I'm gatewaying seem to be announcements.

A caveat: those using the extension should be aware that maintaining the subforum on the message board side takes a lot of work; there's cleaning up Yahoo-inserted message footers, out of office notifications, long legal disclaimers, and other text normally not found in message board posts. It's not too bad for slow lists, but for fast lists, it may take more moderation work than what would be encountered in a non-gatewayed group. For the gatewayed groups, I'm including this message below the page header:

To keep threads in this subforum readable, moderators may edit excessive backquoting, e-mail confidentiality notices and other legal disclaimers, and advertising inserted by the e-mail or mailing list server. They may also delete spam, out-of-office and similar notifications, and off-topic messages that are gatewayed from the mailing list.

See http://www.cyburbia.org/forums/forumdisplay.php?f=34

Thanks for a great script!

I don't think Google is possible, unless there's a mail gateway of some sort. Maybe group alerts for Usenet --> vBulletin, but the other way around? I don't know.

You could try free NNTP servers -- there are many out there -- but odds are they'll be read-only. You probably won't be able to use your ISP's NNTP server because it'll be accessed from your Web host; most ISPs won't allow their NNTP servers to be accessed from an IP range outside what is assigned to that ISP.

If you really want to gateway with a Usenet group, your best bet is a cheap NNTP account with Giganews, EasyNews, or a similar Usenet provider, where you have full access to the NNTP server from any IP.

hi, everybody,

I installed this mod, and working well.

can anybody please tell me the newsgroups/mailing list servers addresses, bcoz, i dont have any idea on this.

and give me suggestions, where and how to get these.

thanks

Okay, this is only a quick hack so I could import my MBOX file (extracted from Yahoo Goops) direct. (most because my server is running qmail).
I hope this gets included in standard. (does not require much polish)

First, install mbox.php from PEAR into the includes directory.

I don't think we are to post complete code - if I'm wong on that please tell me - so here are just the changes to pop.php:
Before
After ReplaceWithafterAddAfterAddReplace this blockwith
Lastly replace WITH
When testing this I imported 10585 messages in 5m20s (not really a benchmark without doing it via POP3 as a comparison however surely the overheads are a lot less with this system)

How does this work? Put a file reference in the host box eg
/usr/local/apache2/www/mbox_locost_oz
where mbox_locost_oz is the MBOX archive. If you are on a Windows server the code would need to be changed (it looks for "/" which will not appear in a host name - would need to be changed to "\")

It will not delete messages from the archive. I do not see this as a bad thing for my purposes (ie dump in starting messages)

I also in my testing dug up a problem when there are no posts at all (I think its a NULL issue) I get this error:
Invalid SQL:
And this comes (in gateway.php)from ALSO somebody was complaining about lack of HTML formatting in Firefox:
in gateway.php change this line:
header("Content-Type: text/plain");
TO
header("Content-Type: text/html");

Having a problem that when I pull the threads in from the newsgroup it slows down my entire site because it locks the post table, does anyone else experience this?

the forum mysql logon does not have permission to lock tables, but seems to do it anyway.

That is disadvantage of MYISAM table. Everytime you write to it. The entire table needs to be locked. INNODB on the other hand, does row level locking. The problem with INNODB is it does not offer Fulltext index (at least with the current version and near future versions). Also unlike MyISAM, InnoDB needs to do a full table scan for COUNT().

There is really nothing you can do about this. This is a on going performance problem faces anyone who owns a board which has many posts.

Perhaps you can put one second delay between post imports. Find this in the NNTP settings under AdminCP.

I have set a pause and will see how it goes.
Thanks.

Hi lierduh,

thx for the 3.5 release.

In your old version for 3.0.x I thought it would be easier, if the server-settings (newsserver, username & password) could be stored as some kind of global setting for the ng. Regular you only use one newsserver with the same pw und login - and with a global setting it would ease the work if you have 20+ ng to setup.

Would it be a mess to make this an option in the next release ?

This hack is awesome...

Everything is working great apart from local posts/repies are not being sent to the newsgroup.

If have the following setting set correctly:

Send message to USENET send_message 1

And the debug mode is saying the message is being posted, but it does not appear in the newgroup.

Any ideas why this would be happening?

Many thanks,
Paul

Managed to find out why. The log was returning 201 which is "server ready - no posting allowed" instead of 200 "server ready - posting allowed"

It's an email to newshosting.com and see if anything can be done.

Again, this is a awesome hack.

gatewayed some groups and after that when I run gateway.php, it is getting

messages to only one group, I tried somany times, it is always coming to only

one group,

what is the problem?

btw in the advanced gateway hacking guide.. you have

i can't seem to find $quickreply anywhere in showthread template. It was there in 3.0x though.

Can some one tell me how to uninstall this hack

How do you uninstall the first release of this? No Uninstall instructions were provided.

Hi lierduh, i've run into a problem.

Everything is working great apart from posting back to the newsgroups.

I have a forum for jokes which I use alt.jokes and i've just posted a few jokes in there.

I checked via a newsreader to see if they were posted but only the first post was sent or is displaying in the newsgroup. I ran gateway.php?debug=1 after I made the posts and showed they were all posted but only the 1st thread was submitted to the newsgroup.

Any idea why this would happen?

Many thanks for your help.

Paul

Is anybody else noticing this to run slow? I mean it took me like 13 days to pull 50k messages.

And now its to the point where it just keeps timing out. I am only pulling 9 groups right now. :(

Also I would like to confirm that it is not my usenet server. I have a premium pay account with a big provider.

Plus now it keeps generating the following.

PHP has encountered a Stack overflow

I need to get this fixed asap.


Oh hell ya. I got this thing moving pretty decent now. :) My usenet server and many others dont like taking that many connections that fast. They will still see the old ones and cuase the timeout errors becuase of hitting the max connections. Becuase I just split the group connect into its own function and just told it that we are working with only one server right now and presto started moving decent.

Thanks
Tim

I would like to uninstall this completely. Can someone give some directions on how to do this?????

Thanks