[trilljester]

Originally Posted by lionheart53

I want only the spider for google adsense to get through and not the others. So I tried changing the spiders_vbulletin.xml to just what's below but then my pages in the forum don't come up at all. Any ideas why? Is there a better way to do this?

For some reason not entirely clear to me, VBulletin doesn't handle a single entry in the spiders_vbulletin.xml file very well. So, just add another Spider in the file. For your example, I added GoogleBot as well as Google Adsense.

Try this spiders_vbulletin.xml:

<?xml version="1.0" encoding="ISO-8859-1"?>

<spiderlist version="1.0">
        <spider ident="Mediapartners-Google">
                <name>Google AdSense</name>
                <type>searchspider</type>
                <info>https://www.google.com/adsense/faq</info>
                <email>adsense-support@google.com</email>
        </spider>
        <spider ident="Googlebot/">
                <name>Google</name>
                <type>searchspider</type>
                <info>http://www.google.com/bot.html</info>
                <email>googlebot@google.com</email>
                <addresses>
                        <address type="range">64.233.160.0-64.233.191.255</address>
                        <address type="range">66.249.64.0-66.249.95.255</address>
                        <address type="range">72.14.192.0-72.14.207.255</address>
                        <address type="range">216.239.32.0-216.239.63.255</address>
                </addresses>
        </spider>
</spiderlist>