Updated vBulletin Spiders List
 

Well since Mosh gave up development on the Spiders list due to medical reasons, I decided to update the list, and try and stay on top of it now.

I have added 220 spiders to his list, which consisted of, 644 spiders, bringing the total now up to 864 spiders in the list.

You can now get the list from here, vBulletin Spiders List Updated

Note: You must be logged in in order to download the list.

That's great! Thanks!

And I'm sorry to be impertinent, but would you think about the having to be logged in part? I used to get the current list by cron, simply downloading it once a month.

I'm a huge fan of automation, obviously (not to mention lazyness ;))

I know Mosh had the download automatic. But I really don't want to go that route. It takes about 45 seconds to sign up, and them maybe another 10 to download it. So the whole process is under a minute. :)

10 seconds to download a 33kb file? It takes a fraction of a second on my side.

I know - and that's perfectly all right, just wanted to ask. It's just that I tend to forget about it. If I think of it, the process is not the problem (I am :D)

That's counting the time after you verified your email and then navigated to the thread. :)

--------------- Added [DATE]1389549769[/DATE] at [TIME]1389549769[/TIME] ---------------

Believe me I know, I tend to forget things myself. :) Thank the computer for remembering my passwords. :)

Great work Ozzy and thanks for updating this.

Thanks :) ozzy47
I'll do it shortly...going to get the kids down for a nap!

Not a problem, took me awhile to get it, but it is all good now. :)

--------------- Added [DATE]1389550310[/DATE] at [TIME]1389550310[/TIME] ---------------

LOL I just got up from a nap. :p

why not upload the list here

Because I want the list on my site for easy maintance. The list mosh had was not on here either.

Then make a test account so we can download it. No one should be forced to register on a site

I am sorry to ask for a minute of your time to get something I spent hours and hours doing. Why did you register to this site?
Why did you register on vB.com?
Why did they not provide you with a test account to download mods?

I am forcing no one to do anything, if you want it then fine, if you don't, that's fine to.

If hours of work someone did is to inconvenient for you to take a minute out of your busy day to register and download the list, then perhaps you are fine with the last one Mosh did. :)

The one mosh did the url needs renewed. All I am asking is you upload this file as it was a long time ago it was updated, just for the ones who don't wish to register

I have not see any that need updating, other than the ones I did. Of course I have not had all 864 spiders on my sites either. If there are ones that need updating, they need to be posted in the thread where the list is so I can update it accordingly.

Hey Mayng, there's a few plugins and such that are exclusive to the site along with the new list. If you want the really COOL FREE toys with more to come, OzzModz is a place to be. It's not a Force deal, Force. But the Force is with you.:D

Already have registered

logged, no download...

Say what?

Sorry!
No complete registration.
Thanks for updating this.

You would not have the same culture as our friend Mosher which provided the download without having to make a register in your forum ozzy47?

Nope, sorry, registering is the only option at this time.

Come on guys, it's not a secret, all you have to do is visit a site that you think has a better spiders list than you and add this after their forum folder /includes/xml/spiders_vbulletin.xml Hit enter and there you have it!

Jeeez does no one learn anything about the forums they run? :(

Sure you could do something like that, but in my opinion that would be a bit raw, I spent alot of time updating the list, and all I ask is for 30 + seconds to register and download the list.

Chris, thats not an attack on you, i'm simply pointing out they have options, if you want to pm me i'll tell you how to prevent that.

If you check you'll see that i registered at your site, that was the option i chose. :)

I know that was not a attack on me, I was just throwing that out there for anyone that may read your post, and think about going that route.

And yes I did see you registered, I do kinda watch everything. :)

Why does someone have to PM you for the answer? Isn't that like asking someone to register?

Everyone's /includes/ directory should be password protected to begin with. For those with apache an .htaccess password is the best way.

Those with cpanel will have a "Password Protect Directory" icon and they can follow the directions to password protect their /includes/ directory. The username/password should be as difficult as possible because no one (including the admin) will ever need to use it. There is no reason anyone should ever have to browse the /includes/ folder and it won't stop the forum from working.

Without cpanel there are plenty of how-tos on Google on how to setup an .htaccess password.

While at it I suggest password protecting your /admincp/ directory too- however this one you will need to give the username/password to any other Admins on your site. Having this can prevent a lot of hacks/security risks from being as damaging as they could be.

Ok, well the easiest way is to simply change the permissions for the file if they don't want to go to the trouble of .htaccess or password protecting folders.

Something wrong with your site ozzy.
I cant register and get the spiders list.

Means something in your user agent string is on the ban list Pal.

Who is your ISP host?