What is Perfect robots.txt for vb5?

[yarick7]

hello guys, im new and like title says my question is what is perfect robots.txt for vb5

i found only for vb4 and not sure if it works for vb5
https://vborg.vbsupport.ru/showthread.php?t=302483

[In Omnibus]

There isn't one. Bad bots ignore robots.txt files.

What are you trying to accomplish?

[IggyP]

didnt they put that functions into the software itself?

thought i read that somewhere...

[yarick7]

Originally Posted by ProSportsForums

There isn't one. Bad bots ignore robots.txt files.

What are you trying to accomplish?

i thought maybe i should close some areas from indexing for security & seo reasons

[IggyP]

i believe you can do that in admincp settings
i know you can for the site, just not 100% how much you can separate in there offhand

[In Omnibus]

Google doesn't index non-content areas in any case.

The best way to go about blocking bots is by user agent.

If security is your concern you can rename admincp and modcp but don't list them in your robots.txt file. That tells the bots where they are.

[Emad ELsayed]

Originally Posted by In Omnibus

Google doesn't index non-content areas in any case.

The best way to go about blocking bots is by user agent.

If security is your concern you can rename admincp and modcp but don't list them in your robots.txt file. That tells the bots where they are.

Can you help me how to rename admincp and modcp folder.

Best Regards

[final kaoss]

This is what I use in my robots.txt

User-agent: *
Disallow: /cgi-bin/
Disallow: /register.php
Disallow: /online.php
Disallow: /admincp/
Disallow: /modcp/
Disallow: /subscription.php

[Seven Skins]

Disallow: /admincp/
Disallow: /modcp/

If it is me I would remove these lines ... because you are telling hackers where your adminCP is.


.

[final kaoss]

Originally Posted by Seven Skins

Disallow: /admincp/
Disallow: /modcp/

If it is me I would remove these lines ... because you are telling hackers where your adminCP is.


.

That's not really too big of a deal because hackers would already know of those folders with a vbulletin exploit lookup which would tell them exactly where the location is anyways. It simply tells spiders, not to index those parts.