View Single Post
  #1  
Old 07-20-2010, 03:13 PM
Winter Sonata Winter Sonata is offline
 
Join Date: Apr 2010
Posts: 232
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default Robots file !!! ?

Hi , I need to prevent all universal bots from visiting my site or index it for sure except Google I want to allow google bots only so I edited my robots file to :


User-agent: Googlebot
Disallow: /vb/admincp/
Disallow: /vb/clientscript/
Disallow: /vb/cpstyles/
Disallow: /vb/customavatars/
Disallow: /vb/customprofilepics/
Disallow: /vb/images/
Disallow: /vb/modcp/
Disallow: /vb/ajax.php
Disallow: /vb/attachment.php
Disallow: /vb/calendar.php
Disallow: /vb/cron.php
Disallow: /vb/editpost.php
Disallow: /vb/global.php
Disallow: /vb/image.php
Disallow: /vb/inlinemod.php
Disallow: /vb/joinrequests.php
Disallow: /vb/login.php
Disallow: /vb/member.php
Disallow: /vb/memberlist.php
Disallow: /vb/misc.php
Disallow: /vb/moderator.php
Disallow: /vb/newattachment.php
Disallow: /vb/newreply.php
Disallow: /vb/newthread.php
Disallow: /vb/online.php
Disallow: /vb/poll.php
Disallow: /vb/postings.php
Disallow: /vb/printthread.php
Disallow: /vb/private.php
Disallow: /vb/profile.php
Disallow: /vb/register.php
Disallow: /vb/report.php
Disallow: /vb/reputation.php
Disallow: /vb/search.php
Disallow: /vb/sendmessage.php
Disallow: /vb/showgroups.php
Disallow: /vb/subscription.php
Disallow: /vb/threadrate.php
Disallow: /vb/usercp.php
Disallow: /vb/usernote.php
Allow: /

User-agent: *
Disallow: /







Is the changed I made right ? or sth should be added ??


Thanks

--------------- Added [DATE]1279672615[/DATE] at [TIME]1279672615[/TIME] ---------------

any help pls ?

--------------- Added [DATE]1279694360[/DATE] at [TIME]1279694360[/TIME] ---------------

Please help
Reply With Quote
 
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01092 seconds
  • Memory Usage 1,764KB
  • Queries Executed 11 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD_SHOWPOST
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)post_thanks_box
  • (1)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (1)post_thanks_postbit_info
  • (1)postbit
  • (1)postbit_onlinestatus
  • (1)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • reputationlevel
  • showthread
Included Files:
  • ./showpost.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_postinfo_query
  • fetch_postinfo
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showpost_start
  • bbcode_fetch_tags
  • bbcode_create
  • postbit_factory
  • showpost_post
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • fetch_musername
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • showpost_complete