The Arcive of vBulletin Modifications Site.

[Release] No Crawlers Tip · **Released**: 06-04-2003

Tip Author: Anthony

Description: This tip allows you to stop the crawlers from indexing your forums (or site) in any way at all. Much better than the Jelsoft way. Just a simple meta-tag addition.

Installation: 2 Minutes (at most)

assassingod · #2 06-05-2003, 03:41 PM

You might want to say that if the instructions look strange in notepad, open it in wordpad

fraqheart · #3 06-06-2003, 09:27 AM

Quote:

Originally Posted by ffdcsite

You might want to say that if the instructions look strange in notepad, open it in wordpad

Yes, I'm very sorry. I'm on a Mac. Lol.

Tony G · #4 06-06-2003, 09:46 AM

Nice mod.

fraqheart · #5 06-06-2003, 10:47 AM

Thank you Tony.

filburt1 · #6 06-06-2003, 06:05 PM

It's not necessarily better...Jelsoft's way bans bots from all files, not just vB-powered, template-based PHP pages.

Mr. Brian · #7 06-06-2003, 08:25 PM

Not even a minute and you're done.

Nice one by the way..

Rufus69 · #8 06-08-2003, 12:09 AM

Hmm...notepad is inferior to metapad. :P

fraqheart · #9 06-08-2003, 03:20 PM

Quote:

Originally Posted by filburt1

It's not necessarily better...Jelsoft's way bans bots from all files, not just vB-powered, template-based PHP pages.

Yeah, but even the Jelsoft way is limited. It only bans robots in a single directory. But if you look at it that way, no root directory means no other directories. Thanks for the enlightenment filburt.