vb.org Archive - Htaccess deny folder access

vb.org Archive (https://vborg.vbsupport.ru/index.php)

- vB3 Programming Discussions (https://vborg.vbsupport.ru/forumdisplay.php?f=15)

- - Htaccess deny folder access (https://vborg.vbsupport.ru/showthread.php?t=242500)

SVTCobraLTD

05-14-2010 02:30 PM

Htaccess deny folder access

I keep getting the following error showing in my cpanel

Quote:

[Fri May 14 07:49:19 2010] [error] [client xxx.xx.xx.xxx] File does not exist: /home/xxxxxx/public_html/forums/photoalbum

How can I block it so spiders are not looking for this photoalbum folder? I am pretty sure all links are removed for that but for some reason, spiders keep looking for it.

vbenhancer

05-14-2010 03:09 PM

spiders are not "visiting" each page of your site, they are crawling and storing the info in their cache... so when they return, they validate their cache by visiting back the pages they crawled once...

so yes, they hit the same files even if they do not exist anymore.

you need to contact your webhost to see if you can learn from them how to manage these details inside your CPanel...

SVTCobraLTD

05-18-2010 02:33 AM

So there is no htaccess setting I can use to block them trying to crawl that section?

USAMustangs.com

05-19-2010 11:51 AM

Just add an exclusion to your robots.txt file

Example:

Code:



User-agent: *

Disallow: /forum/admincp/

Disallow: /forum/modcp/

Disallow: /forums/photoalbum/

forums or forum....how ever you have your forum directory labeled.

And in your .htaccess file in the photoalbum directory, you can insert the following syntax to protect the .htaccess file itself from the outside world.

Code:

<Files .htaccess>

order deny,allow

deny from all

</Files>

SVTCobraLTD

05-19-2010 12:35 PM

Thank you. That was a big help.

All times are GMT. The time now is 01:29 AM.

X vBulletin 3.8.12 by vBS Debug Information
Page Generation 0.00929 seconds Memory Usage 1,725KB Queries Executed 10 (?)
More Information
Template Usage: (1)ad_footer_end (1)ad_footer_start (1)ad_header_end (1)ad_header_logo (1)ad_navbar_below (2)bbcode_code_printable (1)bbcode_quote_printable (1)footer (1)gobutton (1)header (1)headinclude (6)option (1)post_thanks_navbar_search (1)printthread (5)printthreadbit (1)spacer_close (1)spacer_open Phrase Groups Available: global postbit showthread	Included Files: ./printthread.php ./global.php ./includes/init.php ./includes/class_core.php ./includes/config.php ./includes/functions.php ./includes/class_hook.php ./includes/modsystem_functions.php ./includes/class_bbcode_alt.php ./includes/class_bbcode.php ./includes/functions_bigthree.php Hooks Called: init_startup init_startup_session_setup_start init_startup_session_setup_complete cache_permissions fetch_threadinfo_query fetch_threadinfo fetch_foruminfo style_fetch cache_templates global_start parse_templates global_setup_complete printthread_start bbcode_fetch_tags bbcode_create bbcode_parse_start bbcode_parse_complete_precache bbcode_parse_complete printthread_post printthread_complete
Messages: