vb.org Archive
Page 3 of 3 12 3
Show 40 post(s) from this thread on one page

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vB4 General Discussions (https://vborg.vbsupport.ru/forumdisplay.php?f=251)
-   -   Yet another ROBOTS.txt file question (sorry) (https://vborg.vbsupport.ru/showthread.php?t=285363)

zascok 08-05-2012 07:41 PM
Quote:
Originally Posted by Nichtofen (Post 2354783)
Curiously,
Within your code you do not have a "forums/" prefix on your items. That would be required if your forum was located within a forums folder in the root, correct?

all the same with /forums on front of each line for the forum itself, the rest is up to what you have in the root. I just don't have anything else but forum :) so it's right in the top.

Code:
Disallow: /forums/*.js
...
...
Disallow: /forums/xmlsitemap.php

Nichtofen 08-05-2012 07:50 PM
To clarify:
Code:
Disallow: /forums/*.js
...
...
Disallow: /forums/xmlsitemap.php
Has the same exact effect as:
Code:
Disallow: /*.js
...
...
Disallow: /xmlsitemap.php
Just wanted to make sure I understood correctly. I will not bother with changing unless it is necessary. If it automatically seeks a sub-folder on the server anywhere with that name then I will just leave it.

Thanks in advance zascok!

--------------- Added [DATE]1344206047[/DATE] at [TIME]1344206047[/TIME] ---------------

Quote:
Originally Posted by zascok (Post 2354795)
I just don't have anything else but forum :) so it's right in the top.
Gotcha, thanks!

invitezone 08-06-2012 12:08 PM
Quote:
Originally Posted by zascok (Post 2354771)
yup and nope you can't leave it at that you gotta up it into the root of your forum :)
hehehe, erm yeah I understand that much :p
I meant if I don't want to ban any bots or spiders from my site, I just want to limit them to the usual stuff, I can just leave your example file as it is, unedited, and upload that to forum root right?

Thanks

Nichtofen 08-06-2012 08:08 PM
That is correct. Put robots.txt into your root with the contents that zascok gracefully provided. :)


All times are GMT. The time now is 01:19 AM.
Page 3 of 3 12 3
Show 40 post(s) from this thread on one page

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01928 seconds
  • Memory Usage 1,724KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (3)bbcode_code_printable
  • (3)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (2)pagenav_pagelink
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (4)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 
Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 
Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete