Go Back   vb.org Archive > vBulletin 4 Discussion > vB4 General Discussions
FAQ Community Calendar Today's Posts Search

 
 
Thread Tools Display Modes
Prev Previous Post   Next Post Next
  #1  
Old 10-24-2014, 09:29 PM
SpottySocks SpottySocks is offline
 
Join Date: Jun 2008
Location: UK
Posts: 127
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default What should my robot.txt file look like?

Hi guys, I have had an alert from Google Adsense saying the google robot has been denied. This is out of the blue as I haven't had a problem before.

Instructions say to remove the following from my robot.txt file:

Code:
User-agent: Mediapartners-Google
Disallow: /
This is my current robot.txt file content:

Code:
User-agent: *
User-agent: Mediapartners-Google
Disallow:
Disallow:/admincp/
Disallow:/clientscript/
Disallow:/cpstyles/
Disallow:/customavatars/
Disallow:/customprofilepics/
Disallow:/images/
Disallow:/modcp/
Disallow:/ajax.php
Disallow:/attachment.php
Disallow:/calendar.php
Disallow:/cron.php
Disallow:/editpost.php
Disallow:/global.php
Disallow:/image.php
Disallow:/inlinemod.php
Disallow:/joinrequests.php
Disallow:/login.php
Disallow:/member.php
Disallow:/memberlist.php
Disallow:/misc.php
Disallow:/moderator.php
Disallow:/newattachment.php
Disallow:/newreply.php
Disallow:/newthread.php
Disallow:/online.php
Disallow:/poll.php
Disallow:/postings.php
Disallow:/printthread.php
Disallow:/private.php
Disallow:/profile.php
Disallow:/register.php
Disallow:/report.php
Disallow:/reputation.php
Disallow:/search.php
Disallow:/sendmessage.php
Disallow:/showgroups.php
Disallow:/subscription.php
Disallow:/threadrate.php
Disallow:/usercp.php
Disallow:/usernote.php

    
#Begin Attracta SEO Tools Sitemap. Do not remove
sitemap: http://cdn.attracta.com/sitemap/3406644.xml.gz
#End Attracta SEO Tools Sitemap. Do not remove

#Begin Attracta SEO Tools Sitemap. Do not remove
sitemap: http://cdn.attracta.com/sitemap/3406643.xml.gz
#End Attracta SEO Tools Sitemap. Do not remove
Shall I remove what Google Adsense says to move? How should my robot.txt file look?

I use vBSEO so not sure if I should do something via that in the AdminCP or if I should edit the robot.txt file manually.

Thanks all.
Reply With Quote
 


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 06:04 AM.


Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.06505 seconds
  • Memory Usage 2,260KB
  • Queries Executed 12 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)ad_showthread_beforeqr
  • (3)bbcode_code
  • (1)footer
  • (1)forumjump
  • (1)forumrules
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (1)navbar
  • (3)navbar_link
  • (120)option
  • (2)post_thanks_box
  • (2)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (2)post_thanks_postbit_info
  • (2)postbit
  • (2)postbit_onlinestatus
  • (2)postbit_wrapper
  • (1)showthread_list
  • (1)spacer_close
  • (1)spacer_open
  • (1)tagbit_wrapper 

Phrase Groups Available:
  • global
  • inlinemod
  • postbit
  • posting
  • reputationlevel
  • showthread
Included Files:
  • ./showthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_threadedmode.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_postinfo_query
  • fetch_postinfo
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showthread_start
  • showthread_getinfo
  • forumjump
  • showthread_post_start
  • showthread_query_postids_threaded
  • showthread_threaded_construct_link
  • showthread_query
  • bbcode_fetch_tags
  • bbcode_create
  • showthread_postbit_create
  • postbit_factory
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • fetch_musername
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • tag_fetchbit_complete
  • forumrules
  • navbits
  • navbits_complete
  • showthread_complete