vb.org Archive - Miscellaneous Hacks - Ban Spiders by User Agent

Page 25 of 84

« First

Last »

Show 40 post(s) from this thread on one page

vb.org Archive (https://vborg.vbsupport.ru/index.php)

- vBulletin 4.x Add-ons (https://vborg.vbsupport.ru/forumdisplay.php?f=245)

- - Miscellaneous Hacks - Ban Spiders by User Agent (https://vborg.vbsupport.ru/showthread.php?t=268208)

Simon Lloyd

11-25-2011 06:35 AM

It shouldn't create threads and it may have been that typo (thanks for spotting it) in the updated xml i have also added a fix so that if the forumid is blank the routine is exited :)

EuroBeat2

11-25-2011 06:45 AM

Quote:

Originally Posted by Alan_SP (Post 2271653)

Threads are created, but I don't know where. Also I don't know where can I remove them and how? 6 Threads are created at the moment.
.

I had the same problem. However, being stupid I turned ON option to create threads, but have not specified the forum. Obviously threads should not be created if forum was not specified and I believe author is going to fix it.

Anyway, the best way to clear the threads (I got 20 of them) is to use your AdminCP -> Threads And Post -> Prune and purge them. I basically removed them using "Other Option'" and put the string: "Activity From Bot" in the TITLE field and it took care of it. I checked DB and they were removed. After this operation Advanced Statistics Plugin no longer reports them. :)

Hope it helps.

EB

Amadeusmq

11-25-2011 07:07 AM

Does anyone have a pruned list of just the really BAD spiders? Honestly, my only problem has been with Baidu (80 spiders at one point) ....and I'm not really knowledgeable enough to know which of that LONG list are: "really bad", "kindof bad", "annoying", etc.

Thanks!

Simon Lloyd

11-25-2011 07:19 AM

It really depends on your target audience, if you were catering for China then you'd allow Baidu, if you were catering for Russia then you'd allow Yandex (Russian Yahoo), most of the bots in that short list (trust me it is short as there are many more that add no value to your site or stats) are known scrapers, bad bots or foriegn spiders that you just don't need.

Check other sites and see which bots they are allowing, see if they are in your country, research the ones they show to see if they're good or bad for your site.

Amadeusmq

11-25-2011 09:28 AM

Just as a FYI, the "Check Version" option in the admincp->Plugins&Products->Installed Products listing doesn't work.

The error message is:

Quote:

Version check failed. No version number was found at this location. The URL for the version check may be incorrect, or the server may be experiencing problems. Please try again later.

The hard link in the listing does correctly point to this thread; however, the version check doesn't work properly.

Simon Lloyd

11-25-2011 03:14 PM

Thanks i'll sort that out :)

Alan_SP

11-26-2011 01:40 AM

Quote:

Originally Posted by EuroBeat2 (Post 2271693)

Anyway, the best way to clear the threads (I got 20 of them) is to use your AdminCP -> Threads And Post -> Prune and purge them. I basically removed them using "Other Option'" and put the string: "Activity From Bot" in the TITLE field and it took care of it. I checked DB and they were removed. After this operation Advanced Statistics Plugin no longer reports them. :)

Thanks.

I found other method. Go to ACP->Maintenance->Update Counters->Remove Orphan Threads (at the end of list)

This sorted it out quickly and I too didn't see threads anymore.

Alan_SP

11-26-2011 01:44 AM

Quote:

Originally Posted by Simon Lloyd (Post 2271687)

It shouldn't create threads and it may have been that typo (thanks for spotting it) in the updated xml i have also added a fix so that if the forumid is blank the routine is exited :)

Yes, I know. It's very strange that it created this six threads.

Probably you should also put 0 instead 1 in options for thread creating by default? Maybe that could help?

EuroBeat2

11-26-2011 01:46 AM

Quote:

Originally Posted by Alan_SP (Post 2271997)

Thanks.

I found other method. Go to ACP->Maintenance->Update Counters->Remove Orphan Threads (at the end of list)

This sorted it out quickly and I too didn't see threads anymore.

Good thinking. I missed that one.

EB

Simon Lloyd

11-26-2011 05:26 AM

Quote:

Originally Posted by EuroBeat2 (Post 2271693)

...... Obviously threads should not be created if forum was not specified and I believe author is going to fix it.

Fixed :)

Quote:

Originally Posted by Amadeusmq (Post 2271724)

Just as a FYI, the "Check Version" option in the admincp->Plugins&Products->Installed Products listing doesn't work.

The error message is:

The hard link in the listing does correctly point to this thread; however, the version check doesn't work properly.

Fixed :)

Quote:

Originally Posted by Alan_SP (Post 2271999)

Yes, I know. It's very strange that it created this six threads.

Probably you should also put 0 instead 1 in options for thread creating by default? Maybe that could help?

Fixed :)

All times are GMT. The time now is 02:12 PM.

Page 25 of 84

« First

Last »

Show 40 post(s) from this thread on one page

X vBulletin 3.8.12 by vBS Debug Information
Page Generation 0.03506 seconds Memory Usage 1,746KB Queries Executed 10 (?)
More Information
Template Usage: (1)ad_footer_end (1)ad_footer_start (1)ad_header_end (1)ad_header_logo (1)ad_navbar_below (8)bbcode_quote_printable (1)footer (1)gobutton (1)header (1)headinclude (6)option (1)pagenav (1)pagenav_curpage (4)pagenav_pagelink (3)pagenav_pagelinkrel (1)post_thanks_navbar_search (1)printthread (10)printthreadbit (1)spacer_close (1)spacer_open Phrase Groups Available: global postbit showthread	Included Files: ./printthread.php ./global.php ./includes/init.php ./includes/class_core.php ./includes/config.php ./includes/functions.php ./includes/class_hook.php ./includes/modsystem_functions.php ./includes/class_bbcode_alt.php ./includes/class_bbcode.php ./includes/functions_bigthree.php Hooks Called: init_startup init_startup_session_setup_start init_startup_session_setup_complete cache_permissions fetch_threadinfo_query fetch_threadinfo fetch_foruminfo style_fetch cache_templates global_start parse_templates global_setup_complete printthread_start pagenav_page pagenav_complete bbcode_fetch_tags bbcode_create bbcode_parse_start bbcode_parse_complete_precache bbcode_parse_complete printthread_post printthread_complete
Messages: