PDA

View Full Version : [Release] No Crawlers Tip

fraqheart
06-04-2003, 10:00 PM
Tip Author: Anthony

Description: This tip allows you to stop the crawlers from indexing your forums (or site) in any way at all. Much better than the Jelsoft way (http://www.vbulletin.com/robots.txt). Just a simple meta-tag addition. :)

Installation: 2 Minutes (at most)
assassingod
06-05-2003, 04:41 PM
You might want to say that if the instructions look strange in notepad, open it in wordpad;):)
fraqheart
06-06-2003, 10:27 AM
You might want to say that if the instructions look strange in notepad, open it in wordpad;):)

Yes, I'm very sorry. I'm on a Mac. Lol.
Tony G
06-06-2003, 10:46 AM
Nice mod. :)
fraqheart
06-06-2003, 11:47 AM
Thank you Tony. :)
filburt1
06-06-2003, 07:05 PM
It's not necessarily better...Jelsoft's way bans bots from all files, not just vB-powered, template-based PHP pages.
Mr. Brian
06-06-2003, 09:25 PM
Not even a minute and you're done.

Nice one by the way..
Rufus69
06-08-2003, 01:09 AM
Hmm...notepad is inferior to metapad. :P
fraqheart
06-08-2003, 04:20 PM
It's not necessarily better...Jelsoft's way bans bots from all files, not just vB-powered, template-based PHP pages.

Yeah, but even the Jelsoft way is limited. It only bans robots in a single directory. But if you look at it that way, no root directory means no other directories. Thanks for the enlightenment filburt. :)