Updated vBulletin Spiders List
 

Well since Mosh gave up development on the Spiders list due to medical reasons, I decided to update the list, and try and stay on top of it now.

I have added 220 spiders to his list, which consisted of, 644 spiders, bringing the total now up to 864 spiders in the list.

You can now get the list from here, vBulletin Spiders List Updated

Note: You must be logged in in order to download the list.

That's great! Thanks!

And I'm sorry to be impertinent, but would you think about the having to be logged in part? I used to get the current list by cron, simply downloading it once a month.

I'm a huge fan of automation, obviously (not to mention lazyness ;))

I know Mosh had the download automatic. But I really don't want to go that route. It takes about 45 seconds to sign up, and them maybe another 10 to download it. So the whole process is under a minute. :)

10 seconds to download a 33kb file? It takes a fraction of a second on my side.

I know - and that's perfectly all right, just wanted to ask. It's just that I tend to forget about it. If I think of it, the process is not the problem (I am :D)

That's counting the time after you verified your email and then navigated to the thread. :)

--------------- Added [DATE]1389549769[/DATE] at [TIME]1389549769[/TIME] ---------------

Believe me I know, I tend to forget things myself. :) Thank the computer for remembering my passwords. :)

Great work Ozzy and thanks for updating this.

Thanks :) ozzy47
I'll do it shortly...going to get the kids down for a nap!

Not a problem, took me awhile to get it, but it is all good now. :)

--------------- Added [DATE]1389550310[/DATE] at [TIME]1389550310[/TIME] ---------------

LOL I just got up from a nap. :p

why not upload the list here