[Black Snow]

Originally Posted by ozzy47

Say what? This is already recording the blocked bots. In four different possible ways, in a log file, in a thread, in a email and the bots blocked count.

Now writing each bot individually to the DB, is not a good idea, as the table would grow too big, and be a giant PITA when you query it to get the info. Think about it, in just five days, only blocking baidu, I have a count of 9062.

Now lets take that and round it to 10,000 for seven days. Lets say I am going to block the 281 bots I have in my list. 281 x 10,000 x 52 = 146,120,000 entries a year.

Sure each bot is not going to hit me 10,000 times a week, but you can see, this can really grow fast.

And my site is not that busy, now imaginge on a busy site, the entries to the table in the DB could be 250,000,000 plus a year. Now run a query to retrieve the info from that table, and it would hurt the site every time it is ran.

IMO, the best way to go is how it is now, just increase the count every time a bot is blocked, and get that number and display it.

I understand where you are coming from but that is not my intention completely. I will log, for example, Baidu into the database and each time it is blocked, the count will go up by one. I just want to be able to query the DB to see a list of all blocked bots and how many times it was blocked. The log, output.txt, is messy IMHO and I want to be able to query the bots list.