Alright, I did what you said, still no change.

Also, is there an easy way to test this to see it works? It sometimes takes days for new stuff to appear in that page.

No, not really. Just gets lots of spiders to your pages. ;-)

As for the problems you're having, the only thing I can think of is that something is up with your spiders_vbulletin.xml file. You say you pulled down that latest file, but did you rename it to spiders_vbulletin.xml and place it in your includes/xml directory? Also, check the permissions on the file, it should be 644. If it's not chmod it to that.

Actually mikel, I am also having the exact, same problem. I've got many unknown spiders on my forums. Here have a look...

http://www.bonethugsforums.com/spiders.html

Do you have any idea what's wrong?

mike, i did what you said, still nothing, chmod is 644, and i renamed the file and its in correct location.

Yours is normal, the "unknown spiders" are ones that are identified as spiders but are not listed in the spiders_vbulletin.xml file.

we need a massive update of spiderlist.xml..

mikelbeck..the spiders.php page execute a HUGE SQL query..in our page its 416 query..:S ..do u have any idea to reduce sql query in next release???

someone needs to update the spiders.xml file.

Yes, I have a couple of ideas. But I'm not going to be able to get to them for a little while...

thnx man...hope u will impliment those idea to reduced sql query as earlier as possible..:)


TIA.