PDA

View Full Version : Miscellaneous Hacks - Ban Spiders by User Agent


Pages : 1 2 3 [4]

Simon Lloyd
12-19-2014, 09:53 AM
Yes, I know Simon, I thought about doing it that way also, but the payoff, is not worth the trouble. It would bloat the mod, and become a resource hog in no time. :)Thats what i'm saying, if all they want to do with their forums is watch bots/spiders (and thats not what the mod is about) then they'll have hours and hours of fun but no members as the forum would slow down to a snails pace.

People, just rest assured that the mod is doing it's job and giving you back valuable resources please dont waste them again by trying to build in fancyful functionality thats really a whim and not a must have :D

ozzy47
12-19-2014, 09:56 AM
Exactly, which is why I only made it a count of total blocked, it's quick to write, and quick to read and display the count.

I used the analogy, KISS, keep it simple stupid. :)

Simon Lloyd
12-19-2014, 09:58 AM
Exactly, which is why I only made it a count of total blocked, it's quick to write, and quick to read and display the count.

I used the analogy, KISS, keep it simple stupid. :):mad: who you calling stupid????? Lol!

ozzy47
12-19-2014, 10:01 AM
I call myself stupid all the time, when I am writing code. :p

Simon Lloyd
12-19-2014, 10:25 AM
I call myself stupid all the time, when I am writing code. :pHaha!, i hear ya!

Black Snow
12-19-2014, 11:35 AM
Say what? This is already recording the blocked bots. In four different possible ways, in a log file, in a thread, in a email and the bots blocked count.

Now writing each bot individually to the DB, is not a good idea, as the table would grow too big, and be a giant PITA when you query it to get the info. Think about it, in just five days, only blocking baidu, I have a count of 9062.

Now lets take that and round it to 10,000 for seven days. Lets say I am going to block the 281 bots I have in my list. 281 x 10,000 x 52 = 146,120,000 entries a year. :eek:

Sure each bot is not going to hit me 10,000 times a week, but you can see, this can really grow fast. ;)

And my site is not that busy, now imaginge on a busy site, the entries to the table in the DB could be 250,000,000 plus a year. Now run a query to retrieve the info from that table, and it would hurt the site every time it is ran. :mad:

IMO, the best way to go is how it is now, just increase the count every time a bot is blocked, and get that number and display it. :)
I understand where you are coming from but that is not my intention completely. I will log, for example, Baidu into the database and each time it is blocked, the count will go up by one. I just want to be able to query the DB to see a list of all blocked bots and how many times it was blocked. The log, output.txt, is messy IMHO and I want to be able to query the bots list.

ozzy47
12-19-2014, 11:43 AM
I can see that, but as described, that is still going to be something that is totally un necessary, and still slow things down, on a busy site. :)

But it is cool in theory, I started to do just that, but decided against it as I was going along, and found the best thing was to have a running count total. People don't care how many times not X was blocked, just as long as it was blocked. :)

too_cool_3
12-19-2014, 08:52 PM
I have one question regarding Ban Spiders by User Agent. Since many of the User Agent's in the lists contain words like 'bot', 'spider' and 'crawl', will enabling the option Ban Spiders in List ban even good spiders from the forum???

e.g.
Google Spider (crawl-66-249-75-154.googlebot.com)
BingBot Spider (msnbot-157-55-39-186.search.msn.com)

ozzy47
12-19-2014, 08:53 PM
It will only ban spiders you have listed, not all spiders.

Simon Lloyd
12-20-2014, 05:39 AM
I have one question regarding Ban Spiders by User Agent. Since many of the User Agent's in the lists contain words like 'bot', 'spider' and 'crawl', will enabling the option Ban Spiders in List ban even good spiders from the forum???

e.g.
Google Spider (crawl-66-249-75-154.googlebot.com)
BingBot Spider (msnbot-157-55-39-186.search.msn.com)I've explained this many many times throughout all the Ban Spiders By UserAgent threads, take a look here for the latest explanation https://vborg.vbsupport.ru/showpost.php?p=2526789&postcount=652

mradlin
01-05-2015, 01:00 AM
Installed! Works great!

ozzy47
01-05-2015, 09:57 AM
Glad to hear. :)

ikorolis
01-06-2015, 05:29 PM
Don't say nothing for me is the best add on (plugin) for VB

Installed => Updated => Works fine VB 4.2.2 PL3 and finally stop bad bots/spiders.

Simon Lloyd
01-06-2015, 05:58 PM
Glad you like it and its doing its job :)

too_cool_3
01-08-2015, 05:07 PM
I have been using this mod in combination with 'Spambot Stopper - Prevent Spambots from Registering' and 'Hostname or Useragent Registration Ban' for the last 3 weeks and have had only one spammer get through and register on my forum. Previously, 100's were getting through.

I have attached my 'Ultimate Spider List' to be used with this mod. It's a combination of the 3 lists that are linked in the 1st post of this thread. I imported them into excel, removed the duplicates and sorted alphabetically. Simon Lloyd, feel free to add a link to the file in your first post.

ozzy47
01-08-2015, 05:09 PM
Glad to hear that the mods are working so well for you, that is why I recommend them. :)

Max Taxable
01-08-2015, 05:41 PM
Need to take MSIE 1 off the list, that bans IE 10 and 11.

Alan_SP
01-08-2015, 06:50 PM
Yes, I had that problem.

If you want to ban MSIE 1, you need to use MSIE 1. (dot at the end).

RichieBoy67
01-08-2015, 07:34 PM
I have been using this mod in combination with 'Spambot Stopper - Prevent Spambots from Registering' and 'Hostname or Useragent Registration Ban' for the last 3 weeks and have had only one spammer get through and register on my forum. Previously, 100's were getting through.

I have attached my 'Ultimate Spider List' to be used with this mod. It's a combination of the 3 lists that are linked in the 1st post of this thread. I imported them into excel, removed the duplicates and sorted alphabetically. Simon Lloyd, feel free to add a link to the file in your first post.

I would also suggest adding the new Recapatcha! It is pretty amazing!

https://vborg.vbsupport.ru/showthread.php?t=315960

too_cool_3
01-12-2015, 04:55 PM
Need to take MSIE 1 off the list, that bans IE 10 and 11.

Yes, I had that problem.

If you want to ban MSIE 1, you need to use MSIE 1. (dot at the end).

Updated and re-uploaded the Ultimate Spider List txt file in post #765 (https://vborg.vbsupport.ru/showpost.php?p=2531286&postcount=765) to include the dot after MSIE1. Thanks!

Black Snow
01-14-2015, 09:23 AM
Just seen I have 2 Baidu spiders on my forum. I am using vB 4.2.2 PL4 (upgraded from PL2 5 mins ago) and the latest version of this mod.

ozzy47
01-14-2015, 09:26 AM
That is strange, I have been on 4.2.2 pl4 for five days now, and still not one made it through.

Max Taxable
01-14-2015, 04:01 PM
Just seen I have 2 Baidu spiders on my forum. I am using vB 4.2.2 PL4 (upgraded from PL2 5 mins ago) and the latest version of this mod.I've seen them slip through during times where you've had hooks off, like if you were working on something?

DJ5A
01-16-2015, 08:00 PM
Hello Everybody,

Could someone please post me the actual numbers (777?) for the permissions for the output.txt file?

I really like the mod, I had over 30 of the Baidu spiders on my forum. In less than a hour they are gone.

Thanks a Million for all the effort that went into this mod!
DJ5A

PS: I clicked installed... :D

ozzy47
01-16-2015, 10:29 PM
Try 644 or 777

tanzeelniazi
01-25-2015, 07:30 AM
where i see the statistics ?
what do you mean forum home statistics ?

ozzy47
01-25-2015, 09:45 AM
It shows up in the What's Going On area at the bottom of the forums.

tanzeelniazi
01-26-2015, 01:57 PM
You mean Spiders ? If spiders i already Hide

Techno Cowboy
04-16-2015, 03:15 AM
Installed....works great with vB 4.2.2 pl 4!

Working well with vB 4.2.3 Beta 4 also! :D

ForceHSS
04-29-2015, 11:52 PM
on line 429 there is a spelling mistake Bot Mamanger should be Bot Manager
line 417 entity should be entry

Simon Lloyd
05-02-2015, 03:22 PM
Lol thanks for that, although it kind makes it unique :)

ForceHSS
05-02-2015, 06:16 PM
Thanks to ozzy was getting a error with this mod he was kind enough to help fix the problem. If you want access to my site Simon to see the fix I can give it to you pm me if you need it

ozzy47
05-02-2015, 06:24 PM
I think it was unique to your site, as I don't remember getting that error in the logs when I was running this mod.

ForceHSS
05-02-2015, 06:35 PM
Maybe other mods were messing this one up hard to know if you want to post the fix you done, please do then Simon can run whatever tests he needs

rob01
06-01-2015, 01:54 AM
Spiders/Bots Activity Blocked From Site: 4,052

i got this, any idea?

Simon Lloyd
06-01-2015, 02:20 AM
got it where? how?

adnedarn
09-05-2015, 07:10 PM
I've had this installed for a while but recently went to check the logs and it hasn't had any updates in a loooong time. So I deleted the log file and uninstalled the mod. Then reinstalled the mod, set the settings back up and it is showing on the bottom of my forum that spiders are being blocked, but hasn't recreated the log file... I tried manually making the file and setting the permissions but it still didn't write to it. Any ideas?
Thanks!
Andrew

leeluther252
11-13-2015, 03:08 AM
installed

Simon Lloyd
11-13-2015, 03:49 AM
I've had this installed for a while but recently went to check the logs and it hasn't had any updates in a loooong time. So I deleted the log file and uninstalled the mod. Then reinstalled the mod, set the settings back up and it is showing on the bottom of my forum that spiders are being blocked, but hasn't recreated the log file... I tried manually making the file and setting the permissions but it still didn't write to it. Any ideas?
Thanks!
AndrewChances are you dont have permissions to write to the location it's trying to create the log at, if you do then the log permissions need looking at, you'll have to CHMOD them on your server so you can write to it.

MrPink
04-08-2016, 07:08 PM
Installed. Let's see what we get!

nikosb
05-16-2016, 02:24 AM
Installed....works great

markoroots
05-29-2016, 05:36 PM
PLEEEEEEEEEEEEASEEEEEEE HELPPPPPPPPPPPPPPP

I have setted the plugin to redirect to the ip of the bots there are in the list, but it redirect everyone to the own ip, so the site is from today inaccessible.
How can I delete manually the plugin from ftp for a while??

Thanks in advance

MarkFL
05-29-2016, 06:33 PM
PLEEEEEEEEEEEEASEEEEEEE HELPPPPPPPPPPPPPPP

I have setted the plugin to redirect to the ip of the bots there are in the list, but it redirect everyone to the own ip, so the site is from today inaccessible.
How can I delete manually the plugin from ftp for a while??

Thanks in advance

Download your file "includes/config.php" and add this to the top, right below "<?php":

define('DISABLE_HOOKS', true);

Then go into the AdminCP and disable the mod, then comment out the line you added to config.php to re-enable your plugin hooks.

markoroots
05-29-2016, 06:36 PM
Magic Mark!
Really thank you... I was waiting this answer like water in the desert... :)
Thanks... I'm trying.

markoroots
05-29-2016, 07:23 PM
Wow MarkFL you rock!!

Really many thanks you really save me... All the day that no one was understanding what was going on.
This bug would be resolved....

Thanks again Mark I wish you all the best. ;)

Max Taxable
05-29-2016, 09:52 PM
I have setted the plugin to redirect to the ip of the bots there are in the list, but it redirect everyone to the own ip, so the site is from today inaccessible.Using Cloudflare by any chance?

What's happened here isn't a bug in the Mod, it's something unique to your site.

markoroots
05-31-2016, 12:02 PM
Hi Max, no I don't use Cloudflare, but I have only set the option to let redirect the bot to their own ip but then no one was able to reach the forum, everyone was treated like bot.
So if this is never succeeded with no one maybe is my forum...

Max Taxable
05-31-2016, 03:46 PM
Hi Max, no I don't use Cloudflare, but I have only set the option to let redirect the bot to their own ip but then no one was able to reach the forum, everyone was treated like bot.
So if this is never succeeded with no one maybe is my forum...Must be something you shouldn't have, in the ban list I would think.

markoroots
06-01-2016, 06:16 AM
Then quite sure..
because I added "Mozilla" to make a test in that list.
Thanks for the info.
But another thing we have seen that this app is using really more cpu.
Is this normal? And if yes, why?
We had to disable it to reduce the cpu load because have an high increment when is active.

Max Taxable
06-01-2016, 05:09 PM
Then quite sure..
because I added "Mozilla" to make a test in that list.And that caused the entire problem.
But another thing we have seen that this app is using really more cpu.
Is this normal? And if yes, why?
We had to disable it to reduce the cpu load because have an high increment when is active.I've never seen this Mod cause high CPU load, but I imagine it might be able to do so depending on the settings, and the items in the list you're using.

Simon Lloyd
06-05-2016, 11:30 PM
Its not normal to have high CPU usage because of this mod, it hardly uses any resources at all, it redirects right at page call so doesn't even allow your site to load for the banned list, however, if you have banned many things then they will be constantly redirecting, after a short while they will stop visiting your site.

I think you may have other issues going on here, it might be a point to hire Max or Ozzy to take a look at your site and get it optimized properly :)

Max Taxable
06-05-2016, 11:41 PM
I think you may have other issues going on here, it might be a point to hire Max or Ozzy to take a look at your site and get it optimized properly :)Thanks for the reference but neither of us hires out, as policy. Ever. Made a exception and tried it once last summer though, on the insistence of the person we were helping. Didn't end well.

To marko - either of us would be happy to take a look at the situation, for free.

Simon Lloyd
06-05-2016, 11:43 PM
No problem, just thought you two now did it as a business, I haven't been on here in such a long while I'm out of touch :(

Max Taxable
06-05-2016, 11:47 PM
No problem, just thought you two now did it as a business, I haven't been on here in such a long while I'm out of touch :(Since our negative experience last year, neither of us does much at all anymore. Ozzy even less than I unfortunately.

BGN64
06-08-2016, 09:01 AM
I have a user agent showing up in a regular basis, often dozens at a time.

Mozilla/5.0 (Windows NT 6.1; WOW64; rv:34.0) Gecko/20100101 Firefox/34.0

The version is often 34, 29, etc (there are several). I have yet to find a legit user. What string would you suggest to send them on their way?

Simon Lloyd
06-08-2016, 11:25 AM
You can enter the entire string, that way you will only ban users with that exact useragent

Max Taxable
06-08-2016, 04:12 PM
I have a user agent showing up in a regular basis, often dozens at a time.

Mozilla/5.0 (Windows NT 6.1; WOW64; rv:34.0) Gecko/20100101 Firefox/34.0

The version is often 34, 29, etc (there are several). I have yet to find a legit user. What string would you suggest to send them on their way?If they're not doing anything malicious, what's the problem? Did you trace out IP addresses?

Blocking that UA string WILL block legitimate people. It's nothing exotic, it's a Windows 8 computer with only about a year or so old version of Firefox. It's not unusual for people to not upgrade FF.

Just something to think over.

BGN64
06-11-2016, 01:21 PM
Thanks for your reply.

All IPs resolve to China, Iran, Venezuela, Russia etc (at least the several dozen I have checked). I have yet to find one from the US, CA or AU (which are my primary audience). I often have 10-15 on the site at any given time.

markoroots
06-29-2016, 01:47 PM
Thanks for the tips guys and many thanks Max for your availability, I will write you a pm.

grafbyte
07-13-2016, 12:36 PM
hi

after the install ...
Warnung (PHP Warning): stristr(): Empty needle in ..../includes/class_bootstrap.php(103) : eval()'d code (Zeile 100)

Warnung (PHP Warning): stristr(): Empty needle in ..../includes/class_bootstrap.php(103) : eval()'d code (Zeile 110)

mit dis list

baiduspider
beta.statsit.com
statsit
SiteIntel
Yandex
GomezAgent
FunWebProducts
MSIE 1
MSIE 2
MSIE 3
MSIE 4
MSIE 5
MSIE 6
w3m

almaden
Anarchie
Artabus
ASPSeek
attach
autoemailspider
BackWeb
Baidu
Bandit
BatchFTP
BlackWidow
Bot\mailto:craftbot@yahoo.com
Buddy
bumblebee
CherryPicker
ChinaClaw
CICC
Collector
Copier
Copyscape
Crescent
DIIbot
DISCo
DISCo\Pump
dotbot
Download\Demon
Download\Wonder
Downloader
Drip
DSurf15a
eCatch
EasyDL/2.99
EirGrabber
email
EmailCollector
EmailSiphon
EmailWolf
Express\WebPictures
ExtractorPro
EyeNetIE
FileHound
FlashGet
FrontPage
GetRight
GetSmart
GetWeb!
gigabaz
GNIP
Go\!Zilla
Go!Zilla
Go-Ahead-Got-It
gotit
Grabber
GrabNet
Grafula
grub-client
HMView
HTTrack
httpdown
.*httrack.*
ia_archiver
Ichiro
Image\Stripper
Image\Sucker
Indy*Library
Indy\Library
InterGET
InternetLinkagent
Internet\Ninja
InternetSeer.com
Iria
JBH*agent
JetCar
JOC\Web\Spider
JustView
larbin
LeechFTP
LexiBot
lftp
Link*Sleuth
likse
//Link
LinkWalker
Mag-Net
Magnet
Magpie
Mass\Downloader
Memo
Microsoft.URL
MIDown\tool
Mirror
Mister\PiX
Mozilla.*Indy
Mozilla.*NEWT
Mozilla*MSIECrawler
MS\FrontPage*
MSFrontPage
MSIECrawler
MSProxy
Navroad
NearSite
NetAnts
NetMechanic
NetSpider
Net\Vampire
NetZIP
NICErsPRO
Ninja
Nutch
Octopus
Offline\Explorer
Offline\Navigator
omgili
Openfind
PageGrabber
Papa\Foto
pavuk
pcBrowser
Ping
PingALink
Pockey
psbot
Pump
QRVA
RealDownload
Reaper
Recorder
ReGet
Scooter
Seeker
Siphon
sitecheck.internetseer.com
SiteSnagger
SlySearch
SmartDownload
Snake
sogou
Soso
SpaceBison
speedy
Spinn3r
sproose
Stripper
Sucker
SuperBot
SuperHTTP
Surfbot
Szukacz
tAkeOut
Teleport\Pro
URLSpiderPro
Vacuum
VoidEYE
Web\Image\Collector
Web\Sucker
WebAuto
[Ww]eb[Bb]andit
webcollage
WebCopier
Web\Downloader
WebEMailExtrac.*
WebFetch
WebGo\IS
WebHook
WebLeacher
WebMiner
WebMirror
WebReaper
WebSauger
Website
Website\eXtractor
Website\Quester
Webster
WebStripper
WebWhacker
WebZIP
Wget
Whacker
Widow
WWWOFFLE
x-Tractor
Xaldon\WebSpider
Xenu
Yandex
Yeti
YOUDAOBOT
Zeus.*Webster
Zeus



Importiere Sprache, Bitte warten...

VB 4.2.3 (i have change admin foldername)

2.4. If you need German, Spanish or Romanian translation, import
vblang-glowhostspamomatic-210_XX.xml, where XX is the language locale code
(Located at AdminCP -> Languages & Phrases > Download / Upload Languages).

[:]

Warnung (PHP Warning): Illegal string offset 'value' in ..../includes/adminfunctions_language.php (Zeile 651)

Warnung (PHP Warning): Illegal string offset 'value' in ..../includes/adminfunctions_language.php (Zeile 651)

Warnung (PHP Warning): Illegal string offset 'value' in ..../includes/adminfunctions_language.php (Zeile 651)

Warnung (PHP Warning): Illegal string offset 'value' in ..../includes/adminfunctions_language.php (Zeile 651)

Warnung (PHP Warning): Illegal string offset 'value' in ..../includes/adminfunctions_language.php (Zeile 651)

Simon Lloyd
11-01-2016, 02:26 PM
That isn't an issue with this modification as it doesn't use glowhostspamomatic. You also have a blank in your list, this could effectively ban everyone and everything!!

RichieBoy67
11-01-2016, 02:33 PM
hi

after the install ... Warnung (PHP Warning): stristr(): Empty needle in ..../includes/class_bootstrap.php(103) : eval()'d code (Zeile 100)Warnung (PHP Warning): stristr(): Empty needle in ..../includes/class_bootstrap.php(103) : eval()'d code (Zeile 110)mit dis list

Add this to your config under <?php:
define('SKIP_ALL_ERRORS', true);

imported_dboogie2288
12-28-2016, 07:37 PM
I have a dumb question. I'm up on running a forum and such, but not on SEO and what these spiders and bots are actually doing. Since installing this product, I continually notice that the blocked spiders number keeps going up...at an alarming rate. First it was a few hundred, then it was a thousand, and now its about 8100 blocked spiders at a given moment. That was about 3-4 weeks ago. What's going on? Is this something along the lines of, "block them and they will come?" I fear the day that this plug in gets disabled by accident or whatever because the floodgates might come bursting open.

Simon Lloyd
01-03-2017, 06:53 PM
Which bots are showing as increasing in numbers? it's more than likely the same bot that keeps changing IP address, don't worry it will settle down.

w00fy
01-05-2017, 05:06 PM
I just wanted to thank you for this. My site had slowed to a crawl with page load times of 15 seconds and I did not know why. I installed this and my page loads are now mostly under a second.

I had no idea these bots and spiders were doing this to me..after a week I see this.

Spiders/Bots Activity Blocked From Site: 102,285

Thanks again, much appreciated.

Simon Lloyd
01-08-2017, 02:25 PM
I suspect that you have some other process issues that are affecting load times but I'm glad this has helped.

Do take a look at your images that your site has, try to use a CDN to deliver them or maybe create a sprite to contain them all and deliver the images from sprite coordinates, also look at which scripts are called on page load, sometimes its best to try and minimize these and minify your JS scripts, this might help https://hostway.com/blog/10-ways-to-make-your-website-load-faster/

Its a bit of work but well worth the effort.

conaero
04-25-2017, 07:14 AM
I also have been using this product for over year and initially it wiped 90% of the traffic, as they were bots but over time the number has gone back up again.

I would assume what we need is a new list of bots?

Have had a search around but cant find one???

I am using this updated list as per a few posts back:

baiduspider
beta.statsit.com
statsit
SiteIntel
Yandex
GomezAgent
FunWebProducts
MSIE 1
MSIE 2
MSIE 3
MSIE 4
MSIE 5
MSIE 6
w3m

almaden
Anarchie
Artabus
ASPSeek
attach
autoemailspider
BackWeb
Baidu
Bandit
BatchFTP
BlackWidow
Bot\mailto:craftbot@yahoo.com
Buddy
bumblebee
CherryPicker
ChinaClaw
CICC
Collector
Copier
Copyscape
Crescent
DIIbot
DISCo
DISCo\Pump
dotbot
Download\Demon
Download\Wonder
Downloader
Drip
DSurf15a
eCatch
EasyDL/2.99
EirGrabber
email
EmailCollector
EmailSiphon
EmailWolf
Express\WebPictures
ExtractorPro
EyeNetIE
FileHound
FlashGet
FrontPage
GetRight
GetSmart
GetWeb!
gigabaz
GNIP
Go\!Zilla
Go!Zilla
Go-Ahead-Got-It
gotit
Grabber
GrabNet
Grafula
grub-client
HMView
HTTrack
httpdown
.*httrack.*
ia_archiver
Ichiro
Image\Stripper
Image\Sucker
Indy*Library
Indy\Library
InterGET
InternetLinkagent
Internet\Ninja
InternetSeer.com
Iria
JBH*agent
JetCar
JOC\Web\Spider
JustView
larbin
LeechFTP
LexiBot
lftp
Link*Sleuth
likse
//Link
LinkWalker
Mag-Net
Magnet
Magpie
Mass\Downloader
Memo
Microsoft.URL
MIDown\tool
Mirror
Mister\PiX
Mozilla.*Indy
Mozilla.*NEWT
Mozilla*MSIECrawler
MS\FrontPage*
MSFrontPage
MSIECrawler
MSProxy
Navroad
NearSite
NetAnts
NetMechanic
NetSpider
Net\Vampire
NetZIP
NICErsPRO
Ninja
Nutch
Octopus
Offline\Explorer
Offline\Navigator
omgili
Openfind
PageGrabber
Papa\Foto
pavuk
pcBrowser
Ping
PingALink
Pockey
psbot
Pump
QRVA
RealDownload
Reaper
Recorder
ReGet
Scooter
Seeker
Siphon
sitecheck.internetseer.com
SiteSnagger
SlySearch
SmartDownload
Snake
sogou
Soso
SpaceBison
speedy
Spinn3r
sproose
Stripper
Sucker
SuperBot
SuperHTTP
Surfbot
Szukacz
tAkeOut
Teleport\Pro
URLSpiderPro
Vacuum
VoidEYE
Web\Image\Collector
Web\Sucker
WebAuto
[Ww]eb[Bb]andit
webcollage
WebCopier
Web\Downloader
WebEMailExtrac.*
WebFetch
WebGo\IS
WebHook
WebLeacher
WebMiner
WebMirror
WebReaper
WebSauger
Website
Website\eXtractor
Website\Quester
Webster
WebStripper
WebWhacker
WebZIP
Wget
Whacker
Widow
WWWOFFLE
x-Tractor
Xaldon\WebSpider
Xenu
Yandex
Yeti
YOUDAOBOT
Zeus.*Webster
Zeus

WOLF-G4MIN-X
10-11-2017, 07:54 AM
I just installed this on 4.2.5, and as soon as I have it installed, this is showing up on the left upper side of my header where the logo is.


PHP Warning: stristr(): Empty needle in ..../includes/class_bootstrap.php(103) : eval()'d code on line 110

Could anyone tell me if that can be fixed, and if, how ?

Thanks in advance.

Wolf

furnival
08-23-2019, 08:39 AM
Seems to work fine for me on VBulletin 4.2.5 so the error above in @WOLF-G4MIN-X's post must be the Glowhost Spamomatic mod incompatibility mentioned elsewhere in the thread.

Simon Lloyd
08-24-2019, 10:50 AM
I just installed this on 4.2.5, and as soon as I have it installed, this is showing up on the left upper side of my header where the logo is.


PHP Warning: stristr(): Empty needle in ..../includes/class_bootstrap.php(103) : eval()'d code on line 110

Could anyone tell me if that can be fixed, and if, how ?

Thanks in advance.

Wolf
I havent seen this before and it doesn't use the bootstrap, This loads at every page call which prevents the spiders actually loading a page, so it could be a third party hack that doesn't like it being loaded, you could change the load order in the products page of admincp, normally most hacks are set at 5.

martin1
01-20-2020, 11:00 AM
I installed latest version of hack but it not stops huawei crawler service I see multiple entries that are online for example
ecs-159-138-101-77.compute.hwclouds-dns.com

ecs-159-138-109-55.compute.hwclouds-dns.com

Simon Lloyd
01-20-2020, 12:55 PM
Just use this in your ban list,
compute.hwclouds-dns.com

martin1
01-21-2020, 12:10 PM
Just use this in your ban list,
compute.hwclouds-dns.com

I did, it's not blocked.Still showing in online list
Is the latest hack compatibile with 4.2.3pl1 version of the forum?

Simon Lloyd
01-21-2020, 01:20 PM
When you say "online list" are you using another hack like Paul Ms Who's online....etc?

martin1
01-21-2020, 08:38 PM
No, thats the only hack I'm using to ban spiders.
User agents appear under forum user online list , it can be up to 20 entries in the same time.

Forum is behind cloudflare.

Simon Lloyd
01-22-2020, 08:36 AM
Can you PM me a link to your forum?

martin1
01-22-2020, 06:18 PM
sure

martin1
01-25-2020, 07:52 AM
Simon did you checked the forum ?

hwcloud is still browsing

by_online
05-02-2020, 11:48 PM
Hello,
i have also blocked the bots but still seeing them in forum online list.
Anyone with the same issue ?

Simon Lloyd
05-03-2020, 09:47 AM
What other hacks do you have installed, like PaulM's Who's Online....etc?

by_online
05-03-2020, 11:21 AM
Hello,
I have below attached plugins at the moment :

Simon Lloyd
05-03-2020, 04:25 PM
It's possible it's either a bot where you havent actually got the right user agent string or if it is a plugin clash it will only possibly be VSA advanced forum statistics......my money is on the UA string :)

oldfan
05-18-2020, 07:30 PM
Sorry, its been years. But has the bot list been updated?
I'm still getting 100's http://www.metallifukinca.com/online.php

thanks

Simon Lloyd
05-18-2020, 07:35 PM
Sorry, I've never kept an updated list as it's a personal thing, there will be users of this mod that may be able to share theirs with you, but you'd be better of customising your own for which bots are allowed information from your site or not.

oldfan
05-22-2023, 01:39 AM
anyone have a update list please

Simon Lloyd
05-22-2023, 02:18 AM
Even if someone provided a list it would be what's important to them to block and might not suit you or your users as some of the user agent strings of your users may contain something being blocked.in that list.

oldfan
05-23-2023, 12:04 AM
btw the way it works on 4.2.6. pho 7.2 no problem