vb.org Archive - NNTP Gateway for Usenet ( Newsgroups ), Mailing Lists

Page 35 of 74

« First

Last »

Show 40 post(s) from this thread on one page

vb.org Archive (https://vborg.vbsupport.ru/index.php)

- vBulletin 3.5 Add-ons (https://vborg.vbsupport.ru/forumdisplay.php?f=113)

- - NNTP Gateway for Usenet ( Newsgroups ), Mailing Lists (https://vborg.vbsupport.ru/showthread.php?t=92588)

Rik Brown

09-20-2006 12:33 PM

First I want to thank lierduh for his work on developing this mod and krandall for his fixes. We've been importing 3-years of messages from a large newsgroup this week and all appears working well so far (haven't tried exporting yet).

While it would be best to filter out spam and other junk in the importation phase [killfile], one obviously doesn't know what and who to scan for at first. Has anyone developed a series of mySQL commands for the post-importation of messages to work on cleaning up the spam and bad users? If so, could you please advise a sample here that I and perhaps others can build on?

In my case, I would like to:

1) Posts

- delete any post with a URL in it (99% spam)
- delete any post with certain keywords in them
- delete any post by specified users
- delete any post with a URL in the User Name

2) Threads

- delete any thread with a URL in the title
- delete any thread with certain keywords in them
- delete any thread by specified users
- delete any thread with a URL in the User Name

Thanks. -- Rik

KidCharlemane

09-20-2006 03:24 PM

Unfortunately I keep getting an "out of memory" error when I run this hack. Ive used it before with success but for some reason now, it's just not happening. Anyone got any ideas how I can work around the problem? Here is the actual error:

"Fatal error: Allowed memory size of 8388608 bytes exhausted (tried to allocate 3840 bytes) in /usr/local/psa/home/vhosts/trianglecycling.com/httpdocs/includes/functions_newpost.php(181) : regexp code on line 1"

Any ideas?

Aylwin

09-20-2006 04:30 PM

Quote:

Originally Posted by KidCharlemane

Unfortunately I keep getting an "out of memory" error when I run this hack.

Any ideas?

Have you tried allocating more memory to PHP? I can't remember the syntax right now but you can set it in php.ini or .htaccess.

KidCharlemane

09-20-2006 04:36 PM

I dont think I can.. the domain is on a Plesk based system and I dont have access to the administrator control panel.

This is happening on the initial import so I feel pretty sure if I could get all the messages imported, the recent postings between intervals wont cause this problem. I'm trying to import two groups tho with a lot of posts so I dont know how long it will take to actually get them all. It would be nice if you could import XX amount of posts, have the script terminate and then restart to get them all. I dont think memory usage was ever a consideration to the original author of the hack.

TMM-TT

09-20-2006 05:47 PM

Shouldn't a dedicated (?) server have much memory available?

KidCharlemane

09-20-2006 06:01 PM

Depends on how the server is configured. If you run a lot of forums on one machine, you kind of need to keep scripts in check so nothing goes out of control and slows everything else down.

The box I have the partiulcar forum Im testing this hack on isnt mine and the way its configured, PHP scripts are limited to 8mb of memory.

TMM-TT

09-20-2006 06:07 PM

Quote:

Originally Posted by KidCharlemane

The box I have the partiulcar forum Im testing this hack on isnt mine and the way its configured, PHP scripts are limited to 8mb of memory.

My php.ini contains this row:

memory_limit = 8M ; Maximum amount of memory a script may consume (8MB)

... and I don't have any problem with the gateway-script. Strange?

Aylwin

09-21-2006 09:13 AM

Quote:

Originally Posted by KidCharlemane

I dont think I can.. the domain is on a Plesk based system and I dont have access to the administrator control panel.

Doesn't Plesk support custom php.ini files? I believe version 7 did but maybe not newer versions. Or maybe the webhost admins need to enable/allow it. Perhaps you could try to check with them.

My webhost uses cPanel which used to support custom php.ini files. Unfortunately though, it doesn't work anymore after they upgraded to PHP5 (I guess cPanel was also upgraded).

Aylwin

09-21-2006 10:00 AM

How to check incoming posts for valid forum users

I use this mod as a mailing list gateway. Many of the people on our mailing lists are also forum members. So I thought it would be good to check for valid forum users. No guarantees whatsoever but if anyone's interested, here's how I did it.

In gateway.php, look for:

Code:

                                //Separate name and email address

                                $from_name = from_name($message['from']);

                                $from_email = from_email($message['from']);

Below, add:

Code:

                                //Check if the sender is a user

                                $userinfo = $db->query_first("SELECT userid,username FROM " . TABLE_PREFIX . "user WHERE email = '" . $from_email . "'");

                                if ($userinfo['userid']) { $userid = $userinfo['userid']; } else { $userid = 0; }

                                if ($userinfo['username']) { $from_name = $userinfo['username']; }

Look for both instances of:

Code:

                                        $postid = insert_post($threadid, $forumid, $foruminfo, $subject, $from_name, $from_email, $date, $parentid);

Replace both with:

Code:

                                        $postid = insert_post($threadid, $forumid, $foruminfo, $subject, $from_name, $userid, $from_email, $date, $parentid);

In functions_nntp.php, look for:

Code:

function insert_post($threadid, $forumid, $foruminfo, $subject, $from_name, $from_email, $date, $parentid = 0)

Replace with:

Code:

function insert_post($threadid, $forumid, $foruminfo, $subject, $from_name, $userid, $from_email, $date, $parentid = 0)

Look for:

Code:

'" . stripslashes($from_name) . "', 0, '" . $date . "',

Replace with:

Code:

'" . stripslashes($from_name) . "', " . $userid . ", '" . $date . "',

John Diver

09-21-2006 01:31 PM

Hey,

I'm not getting pictures, can pictures be included in posts? Almost all posts I'm getting have images.

Here is my forum for the posts: http://www.deuceace.com/forumdisplay.php?f=24

It also doesn't seem to be showing much text, am I able to change this or is it a limitation of what I am allowed to take from the sites?

All times are GMT. The time now is 01:56 PM.

Page 35 of 74

« First

Last »

Show 40 post(s) from this thread on one page

X vBulletin 3.8.12 by vBS Debug Information
Page Generation 0.01809 seconds Memory Usage 1,751KB Queries Executed 10 (?)
More Information
Template Usage: (1)ad_footer_end (1)ad_footer_start (1)ad_header_end (1)ad_header_logo (1)ad_navbar_below (8)bbcode_code_printable (3)bbcode_quote_printable (1)footer (1)gobutton (1)header (1)headinclude (6)option (1)pagenav (1)pagenav_curpage (4)pagenav_pagelink (2)pagenav_pagelinkrel (1)post_thanks_navbar_search (1)printthread (10)printthreadbit (1)spacer_close (1)spacer_open Phrase Groups Available: global postbit showthread	Included Files: ./printthread.php ./global.php ./includes/init.php ./includes/class_core.php ./includes/config.php ./includes/functions.php ./includes/class_hook.php ./includes/modsystem_functions.php ./includes/class_bbcode_alt.php ./includes/class_bbcode.php ./includes/functions_bigthree.php Hooks Called: init_startup init_startup_session_setup_start init_startup_session_setup_complete cache_permissions fetch_threadinfo_query fetch_threadinfo fetch_foruminfo style_fetch cache_templates global_start parse_templates global_setup_complete printthread_start pagenav_page pagenav_complete bbcode_fetch_tags bbcode_create bbcode_parse_start bbcode_parse_complete_precache bbcode_parse_complete printthread_post printthread_complete
Messages: