vb.org Archive - Spider Watcher

Page 12 of 43

« First

Last »

Show 40 post(s) from this thread on one page

vb.org Archive (https://vborg.vbsupport.ru/index.php)

- vBulletin 3.5 Add-ons (https://vborg.vbsupport.ru/forumdisplay.php?f=113)

- - Spider Watcher (https://vborg.vbsupport.ru/showthread.php?t=104582)

Totti

01-19-2006 06:58 PM

Quote:

Originally Posted by mikelbeck

How do you enable the page generation time for each page? Or is that a hack?

search for microstats on this board

StarBuG

01-20-2006 03:39 AM

Fatal error: Maximum execution time of 30 seconds exceeded in /path/forum/spiders.php on line 70

Guess it is not usable for me either but it is a nice idea.

Needs some improvements ;)

DementedMindz

01-20-2006 05:18 PM

Quote:

Originally Posted by mikelbeck

How do you enable the page generation time for each page? Or is that a hack?

here is the link for the plugin https://vborg.vbsupport.ru/showthread.php?t=82900

Detomah

01-21-2006 01:17 AM

I'm seriously thankful, yet at the same time wishing to god I hadn't installed this hack a few days ago.....

I've been monitoring some of the spiders that visit and i've got a bit of a shock through the addon.

Some of the visitors I thought were guests turn out to be rogue spiders, such as email address hunters, site grabbers and the likes.

I hadn't spotted them in the past, so never knew they were visiting, I just thought they were guests, as that's what it comes up as.

Anyway, after a bit of tweaking and after finding this site:

http://www.kloth.net/internet/badbots.php

Which displays a pretty good list of bad bots and even shows you a couple of good ways to stop them.

I'm now getting a much smoother image of who my visitors are and how many of them are actually real people.

So...

Thanks a bunch for this hack, I wouldn't have believed it would come in so handy. :)

The page is getting pretty big, pretty fast on my site though and I'm sure it's gonna start timing out soon.

Is there any way you could make it, so it runs over multiple pages instead or something like that, to try and cut down the queries?

DementedMindz

01-21-2006 02:27 AM

Detomah reading what you just posted and from reading what he says are good and bad bots is funny.... they say them bots are bad? well strange look at his robots.txt lol he only has one bot in there lol so they must not be too bad huh? http://www.kloth.net/robots.txt

darksoulz

01-21-2006 03:49 AM

Quote:

Originally Posted by mikelbeck

Do you still have the same issue if you apply the mod in this post:

https://vborg.vbsupport.ru/showpost....5&postcount=98

?

hopefully this doesn't turn out too ugly...

Code:

mysql> select bot,timestamp from bots where bot like '%Find%';     

+-----------------------------------------------------------------+---------------------+

| bot                                                             | timestamp           |

+-----------------------------------------------------------------+---------------------+

| findlinks/1.1-a8 (+http://wortschatz.uni-leipzig.de/findlinks/) | 2006-01-20 13:06:27 |

+-----------------------------------------------------------------+---------------------+

1 row in set (0.02 sec)

but on the spiders.php page:

FindLinks 01-19-2006 12:06 PM

Detomah

01-21-2006 04:50 AM

Quote:

Originally Posted by DementedMindz

Yeah I had a look at that before and it amused me a little.

I think he may be simply failing to practice what he preaches.

Although he did say himself, some of the "bad bots" he mentioned aint actually that bad.

nitro

01-21-2006 09:00 AM

Quote:

Originally Posted by Detomah

Nope you both failed to read. It is pointless using robots.txt to dissallow bots that simply ignore or missuse the robots.txt standard. The majority of the bots in that list have the code "M" or "N" which means to ignore or missuse robots.txt

Hence he has a bot trap to deal with them instead. ;)

Brandon Sheley

01-22-2006 08:51 PM

any word on dropping the queries down ?

mikelbeck

01-22-2006 09:20 PM

Quote:

Originally Posted by Loco.M

any word on dropping the queries down ?

Not yet, I haven't had a chance to get back to this. I will try to have a look at it this evening or tomorrow morning.

All times are GMT. The time now is 03:01 PM.

Page 12 of 43

« First

Last »

Show 40 post(s) from this thread on one page

X vBulletin 3.8.12 by vBS Debug Information
Page Generation 0.01559 seconds Memory Usage 1,745KB Queries Executed 10 (?)
More Information
Template Usage: (1)ad_footer_end (1)ad_footer_start (1)ad_header_end (1)ad_header_logo (1)ad_navbar_below (1)bbcode_code_printable (6)bbcode_quote_printable (1)footer (1)gobutton (1)header (1)headinclude (6)option (1)pagenav (1)pagenav_curpage (4)pagenav_pagelink (2)pagenav_pagelinkrel (1)post_thanks_navbar_search (1)printthread (10)printthreadbit (1)spacer_close (1)spacer_open Phrase Groups Available: global postbit showthread	Included Files: ./printthread.php ./global.php ./includes/init.php ./includes/class_core.php ./includes/config.php ./includes/functions.php ./includes/class_hook.php ./includes/modsystem_functions.php ./includes/class_bbcode_alt.php ./includes/class_bbcode.php ./includes/functions_bigthree.php Hooks Called: init_startup init_startup_session_setup_start init_startup_session_setup_complete cache_permissions fetch_threadinfo_query fetch_threadinfo fetch_foruminfo style_fetch cache_templates global_start parse_templates global_setup_complete printthread_start pagenav_page pagenav_complete bbcode_fetch_tags bbcode_create bbcode_parse_start bbcode_parse_complete_precache bbcode_parse_complete printthread_post printthread_complete
Messages: