vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vBulletin 3.6 Add-ons (https://vborg.vbsupport.ru/forumdisplay.php?f=194)
-   -   Administrative and Maintenance Tools - vbStopForumSpam - known spammer lookup for new registrations (https://vborg.vbsupport.ru/showthread.php?t=176481)

ski diva 07-15-2008 09:38 AM

Am I doing something wrong? I can't find "vbStopForumSpam Permissions - Access / View / Submit " for any group in the Usergroup Manager, as directed in the installation process:

Quote:

Edit Usergroup permissions (Optional) (AdminCP -> Usergroup -> Usergroup Manager -> (Group) -> vbStopForumSpam Permissions - Access / View / Submit
Here you can allow specific usergroups access to details in User Ooptions/ Whos Online etc
Am I just not seeing it, or did I do something incorrectly?

pedigree 07-16-2008 08:02 AM

Quote:

Originally Posted by ski diva (Post 1575796)
Am I doing something wrong? I can't find "vbStopForumSpam Permissions - Access / View / Submit " for any group in the Usergroup Manager, as directed in the installation process:



Am I just not seeing it, or did I do something incorrectly?

Nope, youre doing it right, I just jumped the gun and put those in there but never coded the security behind it so it doesnt work. Sorry, I need to remove these from the package as theyve been removed in 0.7 and replaced with another security method

BadgerDog 07-16-2008 11:31 AM

Hi ... :)

I seem to get quite a few of these:

Quote:

[REMOTEERR] Unverfied but allowed by policy
Does ths mean that the host was down when these people registered?

BTW, any ETA on v.7?

Thanks....

Regards,
Badger

pedigree 07-16-2008 01:42 PM

Badger - yes

0.7 is coming along slowly, not as fast as I liked but baby was born yesterday so Im going to have a lot of spare time on my hands over the next couple of weeks.

I might split the stats engine off from this version and release it as 0.8. It will still log all the details to the stats tables, just reporting will be left out.

BadgerDog 07-18-2008 09:24 PM

Quote:

Originally Posted by pedigree (Post 1576824)
0.7 is coming along slowly, not as fast as I liked but baby was born yesterday so Im going to have a lot of spare time on my hands over the next couple of weeks.

Congratulations !!!!!!! :up:

I didn't realize that was going on in the background. :D

Family is far more important then this stuff....

Take it from a 60+ guy, enjoy this terrific time in your life and create some great memories...

Regards,
Badger

StepOnFrog 07-26-2008 12:52 AM

Quote:

Originally Posted by BadgerDog (Post 1570236)
Ok, I just had a legitimate new member try to register and he got the spammer rejection message (our very first)....

It didn't like his IP address, indicating it has been used by someone to spam forums in the past. Here?s the information from the log:



What's very odd is that the actual IP address he was using when he tried to log on our site was IP Address: 195.93.21.8, which differs from the one he was rejected for?

Is something broken here? :confused:

By the way, I changed the username and email address for pivacy purposes.

Regards,
Badger



This MOD *looks* good, but the *most* important thing that users should be aware of is the possibility that a spammer's IP Address on one day (say Sunday 20th July, 2008) may be completely different from the one presented the day after (Monday 21st July, 2008). :eek:

IP addresses are dynamic, especially nowadays that BroadBand has hit off in such a huge way; simple thoughts... how many IP addresses are there, and how many people are there usin the internet, not to mention legitimate businesses? Just check your IP somewhere, switch off you system for a few minutes and restart... then recheck you IP. I'll bet both my hairy ones on the liklihood that your IP will have changed... more so in busy periods.! :erm:

Ergo, don't bother blocking IP Addresses, becuase it's very likely that you'll be blocking legitimate customers.! Really, the way to prevent spamming, is at registration, as this MOD does, but perhaps this MOD should add usernames and email addresses to a list when the Image Verification is failed and session cookie is different on reregistration.... :up:
  • If IV is failed and session cookie/date & time the same as last registration - possibly a legitmate user has input image code wrong, so add user to spammer list, but moderate posts when actually registered.
  • if IV is failed and session cookie/date & time is different from last attempt - likely to be a spammer returning... spambot sends registration info, but fails, and human equivalent returns to register (complete the job), so the session cookie and date/time will have changed for the same username.

The reason for this style of prevention: I've had a few spammers (or possibly the same one) returning to register after the SpamBot had failed only days earlier. :erm:

These threads explain it all in a lot more detail....
https://vborg.vbsupport.ru/showthread.php?t=184030
https://vborg.vbsupport.ru/showthread.php?t=185707
:)

pedigree 07-26-2008 01:44 PM

Like I said, this mod isnt a perfect method of stopping spam. Ive addressed the changing IP issues but if you look at spamhaus / spamcop, are you seriously trying to tell me that this systems are inherently flawed? They stop billions of spams every day. Sure there is colateral damage.... Im guessing from the spambot registrations on my board, in the four figures now, there mightve been 1 false positive and thats what the Contact Us page is for.

Most of my spammers are caught on the email and username fields. If you look at the mod, you can disable checking on the IP number. As spambots dont register a new email address for every forum they try to register on, its a really good field for testing.

This mod gives you control of your forum, it doesnt push policy on anyone. If I want to stop an IP used for spamming within the 24 hours then *I* can. If you dont like the idea that you might block some poor innocent person who had the same IP as some spammer 6 hours after spammer changed IP, then dont test on IP number. From what Ive seen from my logs (and skippy, wired1 etc) is that it blocks a lot of persistent static/near static IP addresses. I think that youll be hard pushed to find a user of this mod complaining that its blocking innocent people on a mass scale but if you do, then why dont you code another mod?

Session cookies so change, restart your browser, its gone. You cant rely on session cookies as spambot engines do cookies. Im working on the mod each day and new features will be added all the time. Maybe Ill take some more time to add your suggested cookie theory... Its adds more control, which is what this mod is about

IP address count is about (256^4) - (2^25 + 2^16 + 2^20) give or take some for subnet broadcast addresses. 10/8 192.168/16 172.16/12 and 224/8 multicast

Alfa1 07-26-2008 04:57 PM

I really like this mod, although the amount of spammers has actually gone up. Maybe the spammers read stopforumspam.com as well and find my board.

The AE detector does find spam bots for me. I did not expect that some spam bots actually can be discovered with cookies. So please do add cookie tracking.

pedigree 07-26-2008 06:49 PM

alfa ill do something like AE detector where the registration process sets a non-vb cookie. all cookie tracking can be extremely easily bypassed by a bot with little coding on the part of the scum writer. With more and more people using spambot posters and more and more boards being spidered/discovered and added to the lists, its bound to happen

what I might do is test a mod addition to rename register.php with another named file with hitting register.php resulting in a temp ban from that ip perhaps.

Ive got some code kind of working, on the list of things to do, where the register form has encoded javascript, where is adds random fields to the input form. If they arent there with the post back, it knows its a spammer (as you cant submit the form without javascript enabled) - i know, i know, forcing javascript is a royal facist thing to do but its another way to hinder spambots.

Alfa1 07-27-2008 12:15 AM

Asides from IP's and cookies, would it be possible to ID spammers based upon mac address or other things?

pedigree 07-27-2008 08:49 AM

MAC address is very difficult as most webservers (I would guess in the high 99.9% here) dont have or allow access to p0f type tools to provide packet level inspection. MAC addresses arent all that unique as once youre removed the device manufacturer ID (which doesnt fill the full 24 bit), you only have a 24bit uniqie ID. There are a lot of network cards out there with the same MAC address and thats fine, just as long as there arent two with the same mac on the same subnet. Filtering on MAC therefore is a no-go area.

Th eonly way to stop automated bot register/post tools is to stop registration by means that the application doesnt know about, extra fields, simple questions, tick this box, click here serverside maps etc. Manual spammers is a different story, you just have to make it as hard as possible.

skippybosco 07-30-2008 02:14 AM

I agree, no solution will be 100% short of encroaching on impacting legitimate users.

For the record, I really like the notion of renaming register.php (obvious risks are third party mods which call that link directly(?!?!) and existing phrases that call it directly.. both manageable.

In that vein, modifying things in the page source like Generator Meta, etc. which specifically call out that you are running a VBulletin site.

That being said, hopefully you are:

1. Spending tons of time with the new child
2. Closing all feature adds for v7 (scope creep is addictive)
3. See #1

:-)

StepOnFrog 07-30-2008 02:21 AM

WOW !!! That was an unnecessarily defensive reply to my post, for which mine was just helping one user be aware of the IP dynamics of t'internet.

------- Please skip past this thread if you don't like long posts -------

Pedigree, where in my post do you think I've attacked your creation?

Apologies to any users, including yourself, Pedigree, should you believe this post is 'Threadwaste/Postwaste', but surely some of you will have got to a point with users misunderstanding the context, or entirety of the posts you make - this is one of those very moments; I am really *sick* to the back teeth of posts not being read correctly, and then someone taking their hat off at some poor user about it.

I really do not see why you have come to be so defensive from what I have written, and so, I feel I should make myself much more clearly understood...


Quote:

Originally Posted by pedigree (Post 1584634)
Like I said, this mod isnt a perfect method of stopping spam. Ive addressed the changing IP issues but if you look at spamhaus / spamcop, are you seriously trying to tell me that this systems are inherently flawed?


In fact, I do not *try* to *tell* you anything about flawed systems at other locations, and I certainly do not, at any point, comment on the level of quality your MOD provides.
Quote:

They stop billions of spams every day. Sure there is colateral damage.... Im guessing from the spambot registrations on my board, in the four figures now, there mightve been 1 false positive and thats what the Contact Us page is for.
I haven't complained about collateral damage. I haven't complained about any of my members not being able to register due to IP blocking. I did, however, directly inform a single user that IP blocking can be a problem for board registrations, other users will read the same post and understand the same. With regards the Conact Us page, should you happen to read any of the many quality articles that other experienced Bulletin Board Admins have written (not just vB), you may come to realise that when an internet user searches, and happens to come across a website, if the information they are seeking is not within the first several clicks, they are more likely to move onto another website; Contact Us, is no guarantee that you will keep a customer in your shop, so to speak. (this is not a criticism to your post, btw).
Quote:

Most of my spammers are caught on the email and username fields. If you look at the mod, you can disable checking on the IP number. As spambots dont register a new email address for every forum they try to register on, its a really good field for testing.

This mod gives you control of your forum, it doesnt push policy on anyone.
Now, that part of your post was, IMO, the only constructive part, in response to my post. Although, looking through your MOD listing description, at no point do you mention any switching of IP blocking facility, or any facilities, as I come to read the description again; only after looking at the second attached screenshot, do I spot a selection box showing ENABLE, and then one must logically assume there is a DISBLE selection too, though, unfortunately, this fact of logic may not be readily obvious to some (honestly, there are users that just don't know, we've all come across them, and we help them).
Quote:

If I want to stop an IP used for spamming within the 24 hours then *I* can.
And, this does seem quite an over-defensive response to something I haven't written; your use of "*I* can" is what pushed me to write this lengthy tome. It appears, judging from your sentence, that you believe I have somehow attempted to stop you from preventing spammers..? Sorry, I fail to see where I have restricted your use of your MOD.
Quote:

If you dont like the idea that you might block some poor innocent person who had the same IP as some spammer 6 hours after spammer changed IP, then dont test on IP number. From what Ive seen from my logs (and skippy, wired1 etc) is that it blocks a lot of persistent static/near static IP addresses. I think that youll be hard pushed to find a user of this mod complaining that its blocking innocent people on a mass scale but if you do, then why dont you code another mod?
I haven't said that I don't like the idea of blocking 'some poor innocent person'. And, why should I code a MOD? I had come to this MOD thread to examine your MOD, to check whether it was the product for me. I did suggest an addition, not only to your MOD, but to any MOD that attempts to prevent spamming registrations by using the points I had listed so many times before, and herein.
Quote:

Session cookies so change, restart your browser, its gone. You cant rely on session cookies as spambot engines do cookies.
You really have misunderstood the suggestions I have made....
You know, as well as I, that vB sets a cookie on your system (or spambot system) each and every visit to your vB board. So, if you record the cookie with each registration, then if that registration fails and another attempt is made with the same username/email, and the cookie is different the second time round, then your vB software will know that the registration MAY be a spambot. For this suggestion to work, you must assume that people are not THICK, and that they will try registering again within the same cookie session, should their first attempt 'balls up', somehow. Ergo, humans register and reregister in the same cookie session, whereas spambots go away and come back later to try again.

Quote:

Im working on the mod each day and new features will be added all the time. Maybe Ill take some more time to add your suggested cookie theory... Its adds more control, which is what this mod is about
Exactly! So, why be so defensive?
Quote:

IP address count is about (256^4) - (2^25 + 2^16 + 2^20) give or take some for subnet broadcast addresses. 10/8 192.168/16 172.16/12 and 224/8 multicast
It's nice to know some people care, and know perfectly well what they're on about...! :D

But, aside from clearing any misunderstandings, I would really like to hear your views on the suggestions I've provided, ie. the failed spambot registrations due to the image verification process.

I hope this has made things much clearer. However, please do not hesitate to contact me with regards any of the above.

Yours,

;-D

pedigree 07-30-2008 01:50 PM

Did what you said, skipped your rant.

No more feature creep, I dont have the time. Maybe in a couple of months when I do.... Who knows but Ill keep your cookie/captcha idea in mind.

pedigree 07-30-2008 01:59 PM

Quote:

Originally Posted by skippybosco (Post 1587123)
1. Spending tons of time with the new child
2. Closing all feature adds for v7 (scope creep is addictive)
3. See #1
:-)

1. Oh yes
2. No more feature creep. Nothing new is going in, Im working on the last stages, data submission to stop forums spam.
3. See #1

:)

Embroidables 07-31-2008 02:40 AM

First of all, let me compliment you on your mod. I really like what you’re doing here. Also, congratulations on the new baby! I know that you are trying to keep the scope of the project from getting out of hand and that you also want to spend time with your family (which, I completely agree with)… But here is a suggestion that would be easy to add and would be a really nice compliment to the mod you already have. When you get a chance, take a look at Project Honey Pot (www.projecthoneypot.org). They have a list of known automated spammer ip addresses similar to the http://www.stopforumspam.com list, except the list is bigger, and probably less vulnerable to list contamination because of the way that the ip addresses are collected. Since they have an established api and sample code it would be really simple to have your mod query their data base in addition to the stop forum spam database.

Here’s a link to some sample code as well as some information about their api:

http://www.projecthoneypot.org/board...10&i=179&t=179
http://www.projecthoneypot.org/httpbl_api

I hope that you like the idea. Let me know what you think.

Wired1 07-31-2008 02:48 AM

Quote:

Originally Posted by pedigree (Post 1585131)
Th eonly way to stop automated bot register/post tools is to stop registration by means that the application doesnt know about, extra fields

BINGO. You wouldn't believe how many spammers I've caught simply because they slapped URLs where it asks for their motherboard :)

pedigree 07-31-2008 07:53 AM

Quote:

Originally Posted by Embroidables (Post 1587965)
First of all, let me compliment you on your mod. I really like what you’re doing here. Also, congratulations on the new baby!

Thank you, its really nice to hear positive feedback

Quote:

I know that you are trying to keep the scope of the project from getting out of hand and that you also want to spend time with your family (which, I completely agree with)… But here is a suggestion that would be easy to add and would be a really nice compliment to the mod you already have. When you get a chance, take a look at Project Honey Pot (www.projecthoneypot.org). They have a list of known automated spammer ip addresses similar to the http://www.stopforumspam.com list, except the list is bigger, and probably less vulnerable to list contamination because of the way that the ip addresses are collected. Since they have an established api and sample code it would be really simple to have your mod query their data base in addition to the stop forum spam database.
Hmm, Im going to go look at this now and if the sample code can be added to the mod without too much trouble (which I hope is that case as I tried to make it flexible), then Ill most certainly add it.

Edit : Ive looked at this and it looks really really good. The code is small and can added very easily to my new code rewrite without too much trouble at all. As its DNS based, I dont have to worry about caching data ike I am with stopforumspam, its lightweight and should make the mod even more useful (to those that have actually installed it)

DangerousDale 07-31-2008 01:39 PM

Cheers for this m8, starting using it yesterday and for the first time in 24hrs I have not got a single spammer ;)

Well Done, have some wine! hehe

Embroidables 07-31-2008 04:49 PM

I'm glad that you liked the honey pot recommendation. By checking both databases the mod should be even that much better at blocking spam.

Alfa1 07-31-2008 07:08 PM

This is getting better and better.

Sym0n 07-31-2008 09:05 PM

Watching this for the next version. :)

Good work.

pedigree 08-01-2008 12:03 PM

Well, I sat down to add the projecthoneypot api but regardless of the times Ive tried to join, email them, etc, I cant get an account created, let alone an API key. If anyone has one that they wouldnt mind me using or knows someone on the project that can sort it, please drop me a line

Thanks

Alfa1 08-01-2008 02:21 PM

Their closed for maintenance:
Quote:

Project Honey Pot is currently undergoing maintenance. As a result, we've turned off some portions of our website, including the page you just requested, however most information can still be accessed if you are logged in. (Don't worry, we're still tracking harvesters and spammers!)

We'll be back online soon, please check back. If you have any questions, you can email us at: maintenance@projecthoneypot.org.

Thanks for your patience.
The Project Honey Pot Team

pedigree 08-01-2008 02:50 PM

that page wasnt there when i tried over the last two days, ill wait I guess, thanks alfa

crocodile 08-02-2008 09:22 PM

hey,
I installed the mod but can't find the log. There is no such log under Statistics & Logs. am I doing install it wrong? thanks

pedigree 08-03-2008 11:01 AM

Its logs are installed under Statistics and Logs as vbStopForumSpam Logs.

What version of vb are you using?

skippybosco 08-04-2008 11:48 AM

My seasonal traffic has died down a bit, but here are my numbers from July:

Out of the 614 registrations for the 31 day period:

~10%/66 were caught by SFS Email check
~21%/128 were caught by SFS UserID check
~27%/166 were caught by SFS IP check
~41%/254 made it past SFS Check (minus 2 that slipped by detection)

A few observations:

1) A significant increase in matches on Email check (10% in July versus .03% in June)
2) A significant decrease in IP matches (27% in July versus 45% in June)
3) A significant increase in valid registrations (41% in July versus 25% in June)

Thanks again pedigree!

pedigree 08-04-2008 08:28 PM

Glad to help

On a note, I spent ages putting a lot of projecthoneypot.org code in there, seems wasted as I cant get a single email reply, confirmation, nothing from them, looks like the people running it have no been eaten by something or just dont care... So Ive removed it all as - I dont test it and if I cant test it, then people that would want to it use cant because the damned login/register system doesnt send confirmation emails for validation.

It a pity, it looked really useful. Who knows, someone there might pull their finger out of their backsides and make their website functional again....

Alfa1 08-04-2008 08:35 PM

Yes, thats a pity. But they seem to be absent at this time. Maybe they are on holidays?? Perhaps in a few weeks...

Embroidables 08-07-2008 06:51 AM

Pedigree,

Check your inbox. I just PMed you my access key.

pedigree 08-07-2008 02:55 PM

... and with that, the code is going back in for testing, thanks Embroidables!!!

pedigree 08-07-2008 08:01 PM

haha, just got a page of emails from them for my account confirmation, hehe

Embroidables 08-07-2008 08:26 PM

cool... it sounds like they finally got their sign up fixed.

BadgerDog 08-27-2008 10:22 AM

Thought I'd report a database error received when trying to sort on IP address ... :)

Quote:

Database error in vBulletin 3.6.7:

Invalid SQL:

SELECT * FROM vbstopforumspam_log AS logs

ORDER BY ip ASC, date DESC
LIMIT 0, 30;

MySQL Error : Unknown column 'ip' in 'order clause'
Error Number : 1054
Date : Wednesday, August 27th 2008 @ 07:18:22 AM
Script : http://www.xxxx.com/admincp/vbstopfo...erby=ip&page=1
Referrer : http://www.xxxx.com/admincp/vbstopfo...y=email&page=1
IP Address : xx.xx.xx.xx
Username : Badger
Classname : vB_Database
Regards,
Badger

skippybosco 08-27-2008 10:33 AM

Good find. I can confirm that I also see this error when sorting VBStopFormLog by IP. (vb3.6.11 running VBSFS .61)

pedigree 08-28-2008 11:25 AM

yeah, it was reported a couple of pages back and its been fixed. Im just trying to find a spare minute in the week to do some more work on it. A newborn, 6 hours/day travel and a kid in the terrible "twos"

Good to see youre on the ball though :)

The wife and the kids are in London tomorrow, leaving me at home without too much work on... I hope to get some code done

pedigree 08-29-2008 10:34 AM

If you go to line 62 in admincp/vbstopforumspam.php and change

$order = 'ip ASC, date DESC';

to

$order = 'ipaddress ASC, date DESC';

then that will fix that error

RedeemedWarrior 08-31-2008 05:09 AM

one of the Best modifcation on the site, its saved me no end of work

over 400 spammers in 48 hours have been stopped

pedigree 08-31-2008 11:51 AM

Quote:

Originally Posted by RedeemedWarrior (Post 1610980)
one of the Best modifcation on the site, its saved me no end of work

over 400 spammers in 48 hours have been stopped

Thanks for the feedback :)

Glad to help. Hopefully, 0.7 will be even better.


All times are GMT. The time now is 08:18 PM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.02095 seconds
  • Memory Usage 1,890KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (20)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (4)pagenav_pagelink
  • (1)pagenav_pagelinkrel
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (40)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete