vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vBulletin 2.x Full Releases (https://vborg.vbsupport.ru/forumdisplay.php?f=4)
-   -   NNTP Gateway (Usenet/Newsgroups) (https://vborg.vbsupport.ru/showthread.php?t=35247)

Ogmuk 03-16-2004 01:27 PM

Thanks. I tried it with that file but the same result. Actually the output is even weirder (small part of the output):
Quote:

Getting message number 49633: forum post
Getting message number 49634: forum post
Getting message number 49635: forum post
Getting message number 49636: Getting message number 49637: forum post
Getting message number 49638: forum post
Getting message number 49639: forum post
Getting message number 49640: Getting message number 49641: Getting message number 49642: forum post
Getting message number 49643: Getting message number 49644: Getting message number 49645: Getting message number 49646: Getting message number 49647: Getting message number 49648: Getting message number 49649: Getting message number 49650: Getting message number 49651: Getting message number 49652: Getting message number 49653: Getting message number 49654: Getting message number 49655: forum post
Getting message number 49656: forum post
Getting message number 49657: forum post
Getting message number 49658: forum post
Getting message number 49659: forum post
Getting message number 49660: forum post
Getting message number 49661: forum post
Getting message number 49662: forum post
To what else could this be related? Dated PHP/MySQL?

allan grossman 03-16-2004 02:32 PM

Quote:

Originally Posted by Ogmuk
Thanks. I tried it with that file but the same result. Actually the output is even weirder (small part of the output):

To what else could this be related? Dated PHP/MySQL?

I have no idea :(

I know I'm not a lot of help here - but the thing should work. I don't know why it doesn't.

Ogmuk 03-16-2004 03:39 PM

Quote:

Originally Posted by allan grossman
I have no idea :(

I know I'm not a lot of help here - but the thing should work. I don't know why it doesn't.

No problem ;) I hope others still read this thread.

Ogmuk 03-16-2004 10:30 PM

Looking back my guess is that emptying the fields useragent and organization caused this odd behavior, that or it just can't handle a full forum prune. I completely emptied the database of my test board and reinstalled. Its working like it should so I won't change those two fields anymore. :)

Only one problem that I still have, it won't add the imported messages to the search index. It will only add the messages that were posted via the forum to the search index. Is there anything specific I have to do to enable this? ;)

edit: I've just tried searching on your forum Allan but I can't search on any words from the Guest users. I assume that this feature isn't available yet so I'll just create the gateway on my live forum without a search option for now.

allan grossman 03-16-2004 11:14 PM

Quote:

Originally Posted by Ogmuk
Looking back my guess is that emptying the fields useragent and organization caused this odd behavior, that or it just can't handle a full forum prune. I completely emptied the database of my test board and reinstalled. Its working like it should so I won't change those two fields anymore. :)

Only one problem that I still have, it won't add the imported messages to the search index. It will only add the messages that were posted via the forum to the search index. Is there anything specific I have to do to enable this? ;)

edit: I've just tried searching on your forum Allan but I can't search on any words from the Guest users. I assume that this feature isn't available yet so I'll just create the gateway on my live forum without a search option for now.

I didn't know you couldn't search on guest users. I'm gonna quit indexing the Usenet forums :D

Can you search on guests from within the forum itself?

allan grossman 03-16-2004 11:16 PM

Quote:

Originally Posted by allan grossman
I didn't know you couldn't search on guest users. I'm gonna quit indexing the Usenet forums :D

Can you search on guests from within the forum itself?

If you rebuild the search index it'll work, I think.

Head back to my forum and search on the keyword "bassist". You'll see all kindsa Usenet hits.

Ogmuk 03-16-2004 11:25 PM

Quote:

Originally Posted by allan grossman
If you rebuild the search index it'll work, I think.

Yup, I think I mentioned that earlier too. Only if you update it manually it will work ;) I was hoping that it would be done automatically.

Another thing I noticed with some quick tests. For example when people use 5 spaces, is there a way to get the 5 spaces to show on your forum too? Some ASCII signatures will not be displayed correctly on your forum is one reason that it would be handy ;)

edit: and a bug I noticed if you edit some of the posts to view their content. This is one piece from a message:

PHP Code:

test test test  test test test  test test test  test test test  test test
test
[color=blue]
test test test  test test test  test test test  test test test  test test[/color]
test[color=blue]
>  
test test test  test test test  test test test  test test test[color=green]
> >  
test test test  test test test  test test test
> >  test test test  test test test  test test test[color=darkred]
> > > 
test test test  test test test  test test test  test test test  test[/color][/color][/color]
test test[color=blue][color=green][color=darkred]
> > > 
test test test  test test test  test test test  test test test
> > > test test test  test test test  test test test  test test test  test[/color][/color][/color]
test test[color=blue][color=green][color=darkred]
> > > 
test test test  test test test  test test test

etc


I'm referring to the large amount of useless repeating COLOR vbcode if it wasn't obvious

[_color=blue][_color=green][_color=darkred]text[_/color][_/color][_/color]

It adds to the database's size when importing hundreds of messages a day ;)

Ogmuk 03-17-2004 09:49 PM

Another thing. How difficult is it to make gateway.php, once it is loaded, convert the posts that were send via the forum into how they will be shown to the rest of the newsgroup, with 72 characters per line, signature, etc?

allan grossman 03-17-2004 11:30 PM

Quote:

Originally Posted by Ogmuk
Another thing. How difficult is it to make gateway.php, once it is loaded, convert the posts that were send via the forum into how they will be shown to the rest of the newsgroup, with 72 characters per line, signature, etc?

Each quoted post will be a different color. Nested quotes, nested colors :)

I don't think you can hack a 72-character display without doing some major alterations on vBulletin files, Ogmuk - the gateway picks up the post *after* it's been posted to the forum. You'd have to hack both newthread.php and newreply.php - and both would be systemwide changes.

Ogmuk 03-17-2004 11:44 PM

I meant it in a way that it would edit the original post and replace it with a 'paste' of the 'echo' (if that makes any sense), so that you can see how it looks without using a newsreader. I think it would only need to remember the latest posts which were uploaded so it can download these with the next synchronization and replace the originals (preferably without turning them into unregistered users. so it would need to only replace the post's content).

No idea if such a thing is possible though or how much work it would be to change this :)

allan grossman 03-18-2004 08:13 AM

It'd be a lot of work. You're talking about changing core functions in the script ;)

Ogmuk 03-18-2004 12:51 PM

Yeah, it probably is. :/

Another thing that made me curious. How do you quote quotes? I tried:
PHP Code:

[quote][quote]text[/quote][/quote

But the result is this:

> > > > text here
> > more text here> >

While I was hoping to get this:

> > text here
> > more text here

allan grossman 03-18-2004 01:26 PM

Quote:

Originally Posted by Ogmuk
Yeah, it probably is. :/

Another thing that made me curious. How do you quote quotes? I tried:

But the result is this:

> > > > text here
> > more text here> >

While I was hoping to get this:

> > text here
> > more text here

When you see nested quotes it's because some folks who post to Usenet are lazy. Rather than cleaning up the quoted text they just hit the 'reply' button and each post that quotes another adds another level of nesting to the mess.

It's one of the pitfalls of Usenet - but I see it on vB forums where people can't be bothered to clean up after themselves and only quote relevant text.

I'm not sure how you'd set the script to ignore nested quotes. I wish I was a programmer, but all I am is a geek :(

Ogmuk 03-18-2004 03:19 PM

I don't want it to ignore nested quotes, I'd rather have it quote the quote (quote twice) like the example I mentioned since that would come useful but now it behaves very odd to these nested quotes.

allan grossman 03-18-2004 03:48 PM

Quote:

Originally Posted by Ogmuk
I don't want it to ignore nested quotes, I'd rather have it quote the quote (quote twice) like the example I mentioned since that would come useful but now it behaves very odd to these nested quotes.

I guess you could try hacking the routine yourself - as long as you're not working on the only copy of gateway.php you have you should be reasonably safe :D

leeherron 03-18-2004 05:21 PM

So no one knows about the changed subject threading bug?

Ogmuk 03-18-2004 05:27 PM

If you disable the edit ability for users in this forum I don't think it can occur, can it?

leeherron 03-18-2004 11:34 PM

No, but people can change the subject line using a news reader; the thread in the newsreaders maintains continuity, but the post with the altered subject creates a new thread.

Bro_Joey_Gowdy 03-21-2004 12:42 AM

/me wonders when this will be officially available for vB3 Gold

jcrash 03-21-2004 11:17 PM

Any idea why my USENT messages wouldn't be returned very frequently from searches? It seems like only threads that I post on via my forum return in the search window.

Ogmuk 03-21-2004 11:22 PM

Quote:

Originally Posted by jcrash
Any idea why my USENT messages wouldn't be returned very frequently from searches? It seems like only threads that I post on via my forum return in the search window.

It seems that imported posts from Usenet aren't automatically added to the search index, although some of us would like to see that differently ;)

himerus 03-22-2004 12:11 AM

I'd like to see a working example of this on 3.0.0 Gold if someone has it... I think it would add a ton of functionality to my board, but I'd like to see some implementation first. :)

Thanks!!!

lierduh 03-22-2004 05:46 AM

Quote:

Originally Posted by leeherron
So no one knows about the changed subject threading bug?

I remember noting that. Before inserting, gateway.php searches for the same subject. It really should insert the post by looking up the reference field.

The original gateway.php does not have reference field, hence it was implemented this way.

One of the TO DO, ie. if no official release comes out soon.:)

Another thing on the TO DO list is the text wrapping for quoted text. Quoted text is wrapped unnecessary at the moment. "> >"s are added to quoted text pushing the line beyond the 72 characters.

lierduh 03-22-2004 05:54 AM

For people who have problems importing or herhaps search index building, please check your web server's error log. There might be clues in there.

One important setting in php.ini you need to change for vB3 is:

memory_limit = 16M ; Maximum amount of memory a script may consume

The default memory_limit is 8MB. vB3 will cripple with only 8MB, but only for large queries.

allan grossman 03-22-2004 11:01 AM

Quote:

Originally Posted by himerus
I'd like to see a working example of this on 3.0.0 Gold if someone has it... I think it would add a ton of functionality to my board, but I'd like to see some implementation first. :)

Thanks!!!

I've had it running for awhile - I'm gatewaying four newsgroups. Works fine under vB3 Gold.

http://ebassist.com

Bro_Joey_Gowdy 03-22-2004 04:32 PM

/me waits patiently for an official usenet gateway release for VB3 Gold

jcrash 03-22-2004 07:52 PM

Quote:

Originally Posted by lierduh
For people who have problems importing or herhaps search index building, please check your web server's error log. There might be clues in there.

One important setting in php.ini you need to change for vB3 is:


memory_limit = 16M ; Maximum amount of memory a script may consume

The default memory_limit is 8MB. vB3 will cripple with only 8MB, but only for large queries.


Well, #1, I dont have access to that file, I think...it would be controlled by my host, right?

Secondly, I'm not sure what you mean by search index building. That all happens automatically, right? You can go to my site here and search on the word "party" it is in a TON of the usenet posts and you won't get one hit.

Ogmuk 03-22-2004 07:58 PM

search index building has to be done manually through the control panel as far as i know

lierduh 03-22-2004 09:04 PM

Quote:

Originally Posted by Ogmuk
search index building has to be done manually through the control panel as far as i know

No, I have a routine to do that in the script after the post is imported.

Around line 364, I have:

build_post_index($postid,$foruminfo);

If the script has an error when building the search index, then the search index won't get built. Also if the "similar thread" function is turned on. It uses the fetch_similar_threads function. This function takes a lot of memory in vB3. If you have only 8MB, then that could well be your problem.

Have you checked your error log? what is your memeory_limit setting?

lierduh 03-22-2004 09:09 PM

Quote:

Originally Posted by jcrash
Well, #1, I dont have access to that file, I think...it would be controlled by my host, right?

Secondly, I'm not sure what you mean by search index building. That all happens automatically, right? You can go to my site here and search on the word "party" it is in a TON of the usenet posts and you won't get one hit.

Yes, your host will control the php.ini file. However, the chances are you can use .htaccess in your forums' directory and increase your memory_limit through an entry of: php_flag

If unclear, google .htaccess and php_flag.

Again, have you checked your error log?

allan grossman 03-22-2004 09:49 PM

Woohoo! lierduh's back!

Good to see you, my man!

kkiely 03-23-2004 02:14 AM

OK, I have read this thread but based on the number to messages in the thread and the updates/re-updates I'm not too clear on whether there is a VB3 Usenet hack or not. The way people are talking here it sounds like there isn't but the following sites have a VB3 usenet hack (from google search "VBulleton 3.0" AND "usenet"

http://www.ebassist.com/vb3/index.php
http://forum.lowcarber.org/
http://www.satelliteguys.us/index.php
http://www.fencing101.com/vb/
http://www.greekspot.org/forums/
http://forums.eyo.com.au/

I'm a newbie so if someone could
1. clean up a lot of the past posting and give an update about a VB3 usenet hack
2. give a download link to the updated file
3. instructions for newbies

i would appreciate it

lierduh 03-23-2004 02:57 AM

Download the hacked gateway.php for vB3 from page 44. Or following the link in the very first post.

himerus 03-23-2004 08:01 AM

I've got it working on vB3 Gold at http://www.myispforum.com/ if anyone is looking for an example... I have two newsgroups currently running:

alt.internet.access
alt.comp

I replied to one newsgroup post, but I'm not sure if that part is working yet, and I have yet to see any new posts come in, but I love the way it looks... Great way to syndicate lots of data for the search engines. :)

Bro_Joey_Gowdy 03-23-2004 12:34 PM

/me waits from an official nntp gateway usenet release within the VB3 Code modification forum

jcrash 03-23-2004 01:12 PM

Quote:

Originally Posted by lierduh
No, I have a routine to do that in the script after the post is imported.

Around line 364, I have:

build_post_index($postid,$foruminfo);

If the script has an error when building the search index, then the search index won't get built. Also if the "similar thread" function is turned on. It uses the fetch_similar_threads function. This function takes a lot of memory in vB3. If you have only 8MB, then that could well be your problem.

Have you checked your error log? what is your memeory_limit setting?


There are no errors in my error log that would pertain to memory etc. A couple missing file errors (nothing php related).

How do I check memory limit?

Ogmuk 03-23-2004 01:17 PM

Quote:

Originally Posted by jcrash
There are no errors in my error log that would pertain to memory etc. A couple missing file errors (nothing php related).

Same here.
Quote:

max_execution_time = 30 ; Maximum execution time of each script, in seconds
memory_limit = 16M ; Maximum amount of memory a script may consume (8MB)

Bro_Joey_Gowdy 03-23-2004 02:28 PM

/me wishes this could work with the vb3 dbprefix

himerus 03-23-2004 02:55 PM

Quote:

Originally Posted by Bro_Joey_Gowdy
[high]* Bro_Joey_Gowdy wishes this could work with the vb3 dbprefix[/high]

?? have you read the thread, or the last post I made? I have it working on vB3 gold, and it seems that others do to.

www.myispforum.com

himerus 03-23-2004 04:51 PM

I can't seem to get a post made in the forum update to the newsgroup... the post works on the site, but it seems to never have been sent back to the NNTP server...

Any Ideas?


All times are GMT. The time now is 04:08 AM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.02507 seconds
  • Memory Usage 1,860KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (2)bbcode_php_printable
  • (19)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (4)pagenav_pagelink
  • (1)pagenav_pagelinkrel
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (40)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete