Robots - why disallow?

[okc]

I am not sure why I want to disallow bots from searching through my site with the "disallow: / " command - don't I want them to spider everything to help my rankings?

thx

[Paul M]

Who told you you should ?

[okc]

A site I was looking at to optimize for search engines.

[Fallback]

It can help your ranking to disallow indexing of some pages and links, particularly links to the same content.

[okc]

Not sure the logic on either side, but do you know any good links to seo advice for vbulletin? thx

[tracylee]

I've always relied on webmasterworld for advice.

[okc]

thx - will check it out