Thread: robots.txt file
View Single Post
  #4  
Old 10-01-2013, 12:45 PM
bzcomputers's Avatar
bzcomputers bzcomputers is offline
 
Join Date: Apr 2012
Location: TX
Posts: 503
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

When using vbSEO Sitemap you must have some information included in your .htaccess file. This information will allow for keeping your vbSEO sitemap creation files secure while still allowing public access to the sitemap themselves.

If you already have an .htaccess file in your root you need to add this:
Code:
RewriteRule ^((urllist|sitemap_).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
If you do not have an .htaccess file in your root:
Code:
RewriteEngine On

RewriteRule ^((urllist|sitemap_).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
...I also notice on your site that you do not force or remove a url prefix (the www.). There are some benefits to forcing the prefix one way or the other, this includes a major SEO related one. Forcing a prefix (one way or the other) will stop search engines from splitting the weight of your urls. Right now your site is being indexed as both: http://telugudosti.com/ and http://www.telugudosti.com/, in turn every url beneath it also has the possibility of being indexed both with www. and without www. This can cause the weight of your urls to be split between to the two addresses causing their overall page ranking to be much lower. By forcing the prefix one way or the other will eliminate this and in short time your duplicate listings will be merged within the search engines creating a single listing for each page and in turn the much higher ranking they deserve.

Although there are many opinions on which way to go (with or without www.). It is really up to you but you should definitely go one way or the other. To do this again you will be editing your .htaccess file by adding this:

To force with www.:
Code:
RewriteCond %{HTTP_HOST} ^telugdosti.com$
Code:
RewriteRule (.*) http://www.telugdosti.com\/$1 [R=301]

To force without www.:
Code:
RewriteCond %{HTTP_HOST} ^www.telugdosti.com$
RewriteRule (.*) http://telugdosti.com\/$1 [R=301]



So if you didn't have an htaccess prior it would now look like:
Code:
RewriteEngine On
Code:
RewriteCond %{HTTP_HOST} ^telugdosti.com$
RewriteRule (.*) http://www.telugdosti.com\/$1 [R=301]

RewriteRule ^((urllist|sitemap_).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]


...
Reply With Quote
Благодарность от:
CAG CheechDogg
 
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01179 seconds
  • Memory Usage 1,795KB
  • Queries Executed 11 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD_SHOWPOST
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (7)bbcode_code
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)post_thanks_box
  • (1)post_thanks_box_bit
  • (1)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (1)post_thanks_postbit
  • (1)post_thanks_postbit_info
  • (1)postbit
  • (1)postbit_onlinestatus
  • (1)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • reputationlevel
  • showthread
Included Files:
  • ./showpost.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_postinfo_query
  • fetch_postinfo
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showpost_start
  • bbcode_fetch_tags
  • bbcode_create
  • postbit_factory
  • showpost_post
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • fetch_musername
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • post_thanks_function_fetch_thanks_bit_start
  • post_thanks_function_show_thanks_date_start
  • post_thanks_function_show_thanks_date_end
  • post_thanks_function_fetch_thanks_bit_end
  • post_thanks_function_fetch_post_thanks_template_start
  • post_thanks_function_fetch_post_thanks_template_end
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • showpost_complete