vb.org Archive - What is Perfect robots.txt for vb5?

Page 1 of 2

Show 40 post(s) from this thread on one page

vb.org Archive (https://vborg.vbsupport.ru/index.php)

- vB5 General Discussions (https://vborg.vbsupport.ru/forumdisplay.php?f=262)

- - What is Perfect robots.txt for vb5? (https://vborg.vbsupport.ru/showthread.php?t=322560)

yarick7

05-06-2016 11:18 PM

What is Perfect robots.txt for vb5?

hello guys, im new and like title says my question is what is perfect robots.txt for vb5

i found only for vb4 and not sure if it works for vb5
https://vborg.vbsupport.ru/showthread.php?t=302483

In Omnibus

05-06-2016 11:29 PM

There isn't one. Bad bots ignore robots.txt files.

What are you trying to accomplish?

IggyP

05-07-2016 12:49 AM

didnt they put that functions into the software itself?

thought i read that somewhere...

yarick7

05-07-2016 01:04 AM

Quote:

Originally Posted by ProSportsForums (Post 2570289)

There isn't one. Bad bots ignore robots.txt files.

What are you trying to accomplish?

i thought maybe i should close some areas from indexing for security & seo reasons

IggyP

05-07-2016 01:13 AM

i believe you can do that in admincp settings
i know you can for the site, just not 100% how much you can separate in there offhand

In Omnibus

05-07-2016 02:01 AM

Google doesn't index non-content areas in any case.

The best way to go about blocking bots is by user agent.

If security is your concern you can rename admincp and modcp but don't list them in your robots.txt file. That tells the bots where they are.

Emad ELsayed

03-25-2018 10:01 AM

Quote:

Originally Posted by In Omnibus (Post 2570295)

Can you help me how to rename admincp and modcp folder.

Best Regards

final kaoss

03-25-2018 08:12 PM

This is what I use in my robots.txt

Code:

User-agent: *

Disallow: /cgi-bin/

Disallow: /register.php

Disallow: /online.php

Disallow: /admincp/

Disallow: /modcp/

Disallow: /subscription.php

Seven Skins

03-26-2018 08:28 PM

Code:

Disallow: /admincp/

Disallow: /modcp/

If it is me I would remove these lines ... because you are telling hackers where your adminCP is.

.

final kaoss

03-26-2018 08:35 PM

Quote:

Originally Posted by Seven Skins (Post 2593763)

Code:

Disallow: /admincp/

Disallow: /modcp/

If it is me I would remove these lines ... because you are telling hackers where your adminCP is.

.

That's not really too big of a deal because hackers would already know of those folders with a vbulletin exploit lookup which would tell them exactly where the location is anyways. It simply tells spiders, not to index those parts.

All times are GMT. The time now is 08:18 PM.

Page 1 of 2

Show 40 post(s) from this thread on one page

X vBulletin 3.8.12 by vBS Debug Information
Page Generation 0.01110 seconds Memory Usage 1,735KB Queries Executed 10 (?)
More Information
Template Usage: (1)ad_footer_end (1)ad_footer_start (1)ad_header_end (1)ad_header_logo (1)ad_navbar_below (3)bbcode_code_printable (3)bbcode_quote_printable (1)footer (1)gobutton (1)header (1)headinclude (6)option (1)pagenav (1)pagenav_curpage (1)pagenav_pagelink (1)post_thanks_navbar_search (1)printthread (10)printthreadbit (1)spacer_close (1)spacer_open Phrase Groups Available: global postbit showthread	Included Files: ./printthread.php ./global.php ./includes/init.php ./includes/class_core.php ./includes/config.php ./includes/functions.php ./includes/class_hook.php ./includes/modsystem_functions.php ./includes/class_bbcode_alt.php ./includes/class_bbcode.php ./includes/functions_bigthree.php Hooks Called: init_startup init_startup_session_setup_start init_startup_session_setup_complete cache_permissions fetch_threadinfo_query fetch_threadinfo fetch_foruminfo style_fetch cache_templates global_start parse_templates global_setup_complete printthread_start pagenav_page pagenav_complete bbcode_fetch_tags bbcode_create bbcode_parse_start bbcode_parse_complete_precache bbcode_parse_complete printthread_post printthread_complete
Messages: