vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vBulletin 4.x Add-ons (https://vborg.vbsupport.ru/forumdisplay.php?f=245)
-   -   Integration with vBulletin - vB Bad Behavior (vB4) (https://vborg.vbsupport.ru/showthread.php?t=261498)

BadgerDog 10-30-2012 11:32 AM

I think they're may be a conflict with this mod and Google's new PageSpeed service, which we've just started to use.... :confused:

We keep getting lots of members complaining of timeouts (blocking?) when they attempt to access our site, which is I believe when Google's caching severs attempt to redirect users to our site. There are hundreds of whois "f1182195" entries in our logs.

They all originate from Google's PageSpeed caching servers with IP addresses in this range 173.194.xx.xx.

Quote:

GET /showthread.php?t=24952&p=137388 HTTP/1.1
Accept: */*
From: googlebot(at)googlebot.com
Connection: Keep-Alive
User-Agent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
X-Pss-Loop: pagespeed_proxy
Accept-Encoding: gzip
Host: www.xxxx.com
Cache-Control: no-cache
X-Forwarded-For: 66.249.74.150
Note: I put the xxx's in the above quote for privacy.

How can I address this, short of turning OFF and not using Bad Behavior? Can I whitelist the range of server IP's and what would be the correct line to add to the whitelist.ini file?

Thanks for any help... :)

Regards,
Doug

Quote:

f1182195 key = HTTP Response: 403
Explanation: An invalid request was received. You claimed to be a major search engine, but you do not appear to actually be a major search engine.
Log Message: User-Agent claimed to be Googlebot, claim appears to be false.

BadgerDog 10-30-2012 10:06 PM

Can some explain to me what this entry in whitelist.ini will allow and not allow as far as IP addresses, to access our site?

I'm trying to understand the .0.0 meaning... does that act as a wildcard so any number in there makes that a vaild entry to be able to access our site?

Thanks.. :)

Regards,'Doug


; Extra GOOGLE ranges
ip[] = "74.125.0.0/99"
ip[] = "216.239.32.0/19"
ip[] = "209.85.128.0/17"
ip[] = "66.102.0.0/20"

TheSupportForum 10-31-2012 06:48 PM

Quote:

Originally Posted by BadgerDog (Post 2377145)
Can some explain to me what this entry in whitelist.ini will allow and not allow as far as IP addresses, to access our site?

I'm trying to understand the .0.0 meaning... does that act as a wildcard so any number in there makes that a vaild entry to be able to access our site?

Thanks.. :)

Regards,'Doug


; Extra GOOGLE ranges
ip[] = "74.125.0.0/99"
ip[] = "216.239.32.0/19"
ip[] = "209.85.128.0/17"
ip[] = "66.102.0.0/20"

the developer hasnt updated them, there are about 3 more ranges
he needs to use, which i put into the whitelist.ini myself

TheSupportForum 11-02-2012 01:20 AM

current issues with 1.0.10
the following varnames are not set as integer

vb_badbehavior_httpbl_threat
vb_badbehavior_httpbl_maxage

vb50kgpoo 11-12-2012 10:49 AM

Keen to download and impliment this as soon as the latest version is available. Just removed another product that was treating GoogleBots as a log referer spammers, and the log file it generated on log file spammers was viewable publicily, so this other mod was actually causing log referer spammers to target my site!!

So please hurry and release the new version Eric

Videx 11-12-2012 01:23 PM

Last month we started getting lots of 403 errors from Google. I can't say I've done a lot of research, but the only thing I remember changing last month was updating this mod (Oct. 19 judging from my posts).

A quick web search pointed to earlier versions of BB causing this, so Saturday evening I disabled this mod and will be keeping an eye on Google webmaster tools to see if the error continues.

TheSupportForum 11-12-2012 01:56 PM

Quote:

Originally Posted by Videx (Post 2380540)
Last month we started getting lots of 403 errors from Google. I can't say I've done a lot of research, but the only thing I remember changing last month was updating this mod (Oct. 19 judging from my posts).

A quick web search pointed to earlier versions of BB causing this, so Saturday evening I disabled this mod and will be keeping an eye on Google webmaster tools to see if the error continues.

thats what i told they guy too but hes not bother about that, googlebot can activity crawl a website unless you change the settings in google webmater tools, the other day i limited to about 5 visits

vb50kgpoo 11-12-2012 02:21 PM

Quote:

Originally Posted by TheSupportForum (Post 2380548)
thats what i told they guy too but hes not bother about that, googlebot can activity crawl a website unless you change the settings in google webmater tools, the other day i limited to about 5 visits

Oh dear, and I was so hopefuly this mod would be good, as I had to remove another product for labelling Googlebot as a referer spammer and creating a referal spam hole in my site.

TheSupportForum 11-12-2012 04:51 PM

Quote:

Originally Posted by vb50kgpoo (Post 2380553)
Oh dear, and I was so hopefuly this mod would be good, as I had to remove another product for labelling Googlebot as a referer spammer and creating a referal spam hole in my site.

ok well you still dont understand then this product, and my product both use the projecthoneypot API so if its more than 1 product identifiying the same issue

then my guess as i said before it projectshoneypot not our mods

Videx 11-12-2012 05:36 PM

I too installed a honeypot way back when I first installed this mod. But I haven't done anything to change it since. So unless last month's BB update affected it, I'm not sure I can blame the honeypot. But I guess I'm going to have to look up the uninstallation instructions just in case.

edit: Turning off Honey Pot was as simple as going to the dashboard on their site and clicking the link. I also deleted the one html page in my html root that I had put there for them. However, it was not the page giving me 403 errors.

I also checked Google Webmaster tools and there was only a single bad gateway error listed since I turned off BB Saturday. No 403 errors.

vb50kgpoo 11-13-2012 09:58 AM

Quote:

Originally Posted by TheSupportForum (Post 2380597)
ok well you still dont understand then this product, and my product both use the projecthoneypot API so if its more than 1 product identifiying the same issue

then my guess as i said before it projectshoneypot not our mods

Sorry, your English and rational both are very poor, can you restate your text please?

TheSupportForum 11-13-2012 01:10 PM

Quote:

Originally Posted by vb50kgpoo (Post 2380756)
Sorry, your English and rational both are very poor, can you restate your text please?

sorry i will simplify

both this product and mine use projecthoneypot and you said it basically reports the same as mine, so as a suggestion you will need to contact projecthoneypot
with the IP's from the bots so they can investigate it for you


more than likely both our mods report the same thing because its designed to do that
google webmaster tools suggests that it has not issues crawling and no errors visiting

vb50kgpoo 11-13-2012 01:23 PM

Quote:

Originally Posted by TheSupportForum (Post 2380794)
sorry i will simplify

both this product and mine use projecthoneypot and you said it basically reports the same as mine, so as a suggestion you will need to contact projecthoneypot
with the IP's from the bots so they can investigate it for you


more than likely both our mods report the same thing because its designed to do that
google webmaster tools suggests that it has not issues crawling and no errors visiting

Eh, no, that is not what I said. That is what you summized and wrongly reported. Your product wrongly labels GoogleBot as a link referer spammer when project honeypot says nothing of the sort; project honeypot says the bot is Google, nothing more, so why would I want to contact them? Anyway, it is mute, as your product has multiple flaws, including the fact the report file is targetting by link referer spammers (your report file is publicly viewable and therefore when it reports the actions of a spammer, it thereby gives the spammer a file / link back to exploit) and I have now uninstalled it.

I have reinstalled Ban Spider by UserAgent which is excellent, and I am waiting for this Bad Behavior mod to be updated so I can also install it.

BadgerDog 11-13-2012 02:41 PM

Quote:

Originally Posted by Videx (Post 2380602)

I also checked Google Webmaster tools and there was only a single bad gateway error listed since I turned off BB Saturday. No 403 errors.

I'm not sure, but I think this mod may be getting in the way of Google services as well....

We operate Google's PageSpeed Service and we've been seeing a LOT of errors...

Maybe it's something else, but I've turned OFF this mod for now until someone can validate it's working correctly.

We were one of the original PayPal donators to thank the developer for the project ..

Regards,
Doug

vb50kgpoo 11-13-2012 03:22 PM

Quote:

Originally Posted by BadgerDog (Post 2380814)
I'm not sure, but I think this mod may be getting in the way of Google services as well....

We operate Google's PageSpeed Service and we've been seeing a LOT of errors...

Maybe it's something else, but I've turned OFF this mod for now until someone can validate it's working correctly.

We were one of the original PayPal donators to thank the developer for the project ..

Regards,
Doug

Dang!

I wish someone would produce a bad behaviour mod that has a bot (by name) whitelist, where anything in the whitelist is given a reverse dns lookup to verify they are whom they say. Because it seems this is a common enough problem, and the last bot I want to block is GoogleBot.

Videx 11-13-2012 05:13 PM

Update: We have now risen back where we belong on a Google search - well, almost - we're #2 behind Wikipedia. We had fallen all the way back several pages.

I noticed another oddity. When I went to Webmaster Tools last Saturday it only showed my site as "Shannondale.org", so I added "www.Shannondale.org". I always thought they were basically the same, but this morning I see my vb sitemap is only showing as having been submitted to "www.Shannondale.org". Does Google really expect two sitemaps and can vb even do that?

vb50kgpoo 11-15-2012 10:12 AM

Quote:

Originally Posted by Videx (Post 2380839)
Update: We have now risen back where we belong on a Google search - well, almost - we're #2 behind Wikipedia. We had fallen all the way back several pages.

I noticed another oddity. When I went to Webmaster Tools last Saturday it only showed my site as "Shannondale.org", so I added "www.Shannondale.org". I always thought they were basically the same, but this morning I see my vb sitemap is only showing as having been submitted to "www.Shannondale.org". Does Google really expect two sitemaps and can vb even do that?

You want to avoid this, it can affect your rankings. Recommend you use htaccess to cover all bases (.domain-name.com, IP Address - resolve them both to www.domain-name.com).

Naijasite 11-17-2012 06:19 PM

am unstallingg. i use the default setting ....all guest are unable to view the forum,

see the error message

Error 403

We're sorry, but we could not fulfill your request for / on this server.

You do not have permission to access this server. Before trying again, run anti-virus and anti-spyware software and remove any viruses and spyware from your computer.

Your technical support key is: 5bc8-9c4f-2b02-1b1f

You can use this key to fix this problem yourself.

If you are unable to fix the problem yourself, please contact help(@)naiji(.)com and be sure to provide the technical support key shown above.

Alfa1 11-19-2012 02:06 AM

Do not be fooled by the massive number of fake Google bots that are around these days. If the IP/CIDR does not reveal a Google bot then its fake.

Add the following to your whitelist.ini to unblock Google, Baidu Japan and Facebook:
Code:

; Extra GOOGLE ranges
ip[] = "66.102.0.0/20"
ip[] = "173.194.0.0/16"
; Extra Baidu ranges
ip[] = "180.76.0.0/19"
ip[] = "119.63.196.0/19"
; Extra Facebook ranges
ip[] = "69.171.224.0/19"
ip[] = "173.252.64.0/18"
ip[] = "66.220.144.0/20"

Please be so kind to include the above into the next release.
The above CIDR ranges come from checking the whois on all bots that visited my big board while I had BB turned off for testing. The above IP ranges belong to valid spiders which are blocked if this is not added to the whitelist.

Does BB whitelist the IPs of pingdom?
https://www.pingdom.com/rss/probe_servers.xml
Pingdom should be whitelisted

vb50kgpoo 11-20-2012 06:52 AM

Quote:

Originally Posted by Alfa1 (Post 2382403)
Do not be fooled by the massive number of fake Google bots that are around these days. If the IP/CIDR does not reveal a Google bot then its fake.

Add the following to your whitelist.ini to unblock Google, Baidu Japan and Facebook:
Code:

; Extra GOOGLE ranges
ip[] = "66.102.0.0/20"
ip[] = "173.194.0.0/16"
; Extra Baidu ranges
ip[] = "180.76.0.0/19"
ip[] = "119.63.196.0/19"
; Extra Facebook ranges
ip[] = "69.171.224.0/19"
ip[] = "173.252.64.0/18"
ip[] = "66.220.144.0/20"

Please be so kind to include the above into the next release.
The above CIDR ranges come from checking the whois on all bots that visited my big board while I had BB turned off for testing. The above IP ranges belong to valid spiders which are blocked if this is not added to the whitelist.

Does BB whitelist the IPs of pingdom?
https://www.pingdom.com/rss/probe_servers.xml
Pingdom should be whitelisted


The trouble is, you do not know whether something is a true GoogeBot or not as Google do not publish all of their IP ranges for obvious reasons. The only safeguard is to do a reverse dns lookup.

Alfa1 11-20-2012 08:41 AM

Quote:

Originally Posted by vb50kgpoo (Post 2382809)
The trouble is, you do not know whether something is a true GoogeBot or not as Google do not publish all of their IP ranges for obvious reasons. The only safeguard is to do a reverse dns lookup.

What obvious reasons?
620 Googlebots are currently visiting my site with published IP ranges. I wonder what harm there is in blocking unpublished IP ranges.

vb50kgpoo 11-20-2012 10:33 AM

Quote:

Originally Posted by Alfa1 (Post 2382823)
What obvious reasons?
620 Googlebots are currently visiting my site with published IP ranges. I wonder what harm there is in blocking unpublished IP ranges.

In case Google's algo thinks you are feeding Googlebot one set of results, while actually serving other visitors another. Look it up. Google expressly state they do not publish all their IP ranges. Look around forums like webmasterworld

tpearl5 12-10-2012 06:56 PM

I highly recommend everyone update to the latest version, 2.2.13 , since it has updates to the way that googlebot and others are detected.

Eric 12-20-2012 10:48 PM

Updated to BB 2.2.13 and added some ranges to whitelist.ini

https://github.com/ericsizemore/vb_b...ree/master/vb4

I do plan on actually uploading it to vB.org this time! But I will not be able to until tomorrow.

jderouen 12-21-2012 01:47 PM

I've just installed. I don't understand about half of the options, I assume in that case I should just leave whatever it's set on default, correct?

Eric 12-23-2012 10:55 AM

Got caught up in a few things, but will be putting up an update here as soon as I can. Sorry guys.

Quote:

Originally Posted by jderouen (Post 2392054)
I've just installed. I don't understand about half of the options, I assume in that case I should just leave whatever it's set on default, correct?

In a situation such as this, yes, I would recommend leaving the defaults. :)

chaz7979 01-05-2013 06:59 PM

Just so I am clear...

I should install vb4-1.0.10.zip and then download the latest version of BB from the website and overwrite the files in the BB folder?

Alfa1 01-07-2013 01:35 AM

Is it so complex or time expensive to upload a zipfile to vb.org? I find this hard to understand.

In any case: thanks for your efforts.

Kyo-dono 01-10-2013 10:44 AM

Quote:

Originally Posted by Eric (Post 2391966)
Updated to BB 2.2.13 and added some ranges to whitelist.iniDownload Now

Its still missing here in "Download Now". :)

I will test it too.

I have look in http://bad-behavior.ioerror.us/support/installation/ and click on "My software is not listed.", but get only "(Data to be restored soon? contact me if you need immediate help)". Is here a instruction for installation on a custom php file or for kohana framework?

tpearl5 01-10-2013 11:37 AM

Yep, download it here: http://bad-behavior.ioerror.us/2012/...havior-2-2-13/

They're the same files that are in the mod, just updated.

Kyo-dono 01-13-2013 06:54 PM

There are statistics of forums operators, how much spam is decreased?
My moderators says it is 50% less. Is this a good value for this addon?

BTW I use "Spammers suck!" addon too.

Kyo-dono 01-16-2013 06:02 PM

1. Is it possible to use this check ONLY for the registration page?

2. Tons of users get a false detection for ONE topic and send me a "technical support key". What is this key and what I can do with it? ^^°

Alfa1 01-16-2013 08:24 PM

The key shows you what the issue is. You can go into your admincp to the BB log and find the incidents. That should quickly make clear why the users are being blocked.
Its possible that some of your users are using a fishy browser plugin. Its amazing what people install because its free.

Kyo-dono 01-16-2013 09:41 PM

I was in "adminCP->Statistics & Logs->vB Bad Behavior Logs" there is no input for this key and there is nowhere such a key. :confused:
All users get this output:
Quote:

Technical Support

Your request contained data which is consistent with spam, active malware, viruses, or similar software.

To resolve this problem, clean your computer of viruses and other malware.
-------------------------------

Quote:

Its possible that some of your users are using a fishy browser plugin.
No, I don't think so. All (100%) users get this false detection in one topic. Exception admins (and mods?). This "bug" is only(found only this) in one topic of my forum and happen only if you change the page of this topic. I do not understand why.

Add. There is a bug in 403 site of this addon I have marked it bold):

Quote:

If you are unable to fix the problem yourself, please contact <a href="mailto:support(&amp;#64;)domain(&amp;#46;)com">support(&amp;#64;)domain(&amp;#46;)com</a> and be sure to provide the technical support key shown above.

Kyo-dono 01-26-2013 09:38 AM

I have deinstalled it. Only 50% chance to detect spammer and it have a bad bug in detection of spammers.

I changed to "Spam-O-Matic" and now >90% of spammers are blocked. o/

Is here stopforumspam.com database so much better as projecthoneypot.org?

Alfa1 01-27-2013 12:59 AM

These are two different things. SFS blocks registration, while BB blocks useragents. I use both stopforumspam and badbehavior together and that works really well.

Please be aware that Spam-O-Matic advertises forum hosting to your moderating team, but does not display this to admins.

Eric 02-05-2013 07:05 AM

Version 1.0.12, 12/21/2012 -- Released: 02/05/2013
  • Bad Behavior upgraded to 2.2.13
  • Added some more ranges to whitelist.ini

Eric 04-23-2013 04:01 PM

Version 1.0.13, 04/23/2013
  • Bad Behavior upgraded to 2.2.14

chaz7979 04-23-2013 04:56 PM

Thanks for taking the time to update the VB plugin as well.

BTW, can we assume no new options/settings if nothing is mentioned in the changelog?

Eric 04-25-2013 03:28 PM

Quote:

Originally Posted by chaz7979 (Post 2418116)
Thanks for taking the time to update the VB plugin as well.

BTW, can we assume no new options/settings if nothing is mentioned in the changelog?

That is correct. At this point only Bad Behavior itself has been updated. The product file only changed to reference the new version number.


All times are GMT. The time now is 04:22 AM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01425 seconds
  • Memory Usage 1,857KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (2)bbcode_code_printable
  • (21)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (3)pagenav_pagelink
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (40)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete