Go Back   vb.org Archive > vBulletin 4 Discussion > vB4 General Discussions
Prev Previous Post   Next Post Next
  #1  
Old 10-24-2014, 09:29 PM
SpottySocks SpottySocks is offline
 
Join Date: Jun 2008
Location: UK
Posts: 127
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default What should my robot.txt file look like?

Hi guys, I have had an alert from Google Adsense saying the google robot has been denied. This is out of the blue as I haven't had a problem before.

Instructions say to remove the following from my robot.txt file:

Code:
User-agent: Mediapartners-Google
Disallow: /
This is my current robot.txt file content:

Code:
User-agent: *
User-agent: Mediapartners-Google
Disallow:
Disallow:/admincp/
Disallow:/clientscript/
Disallow:/cpstyles/
Disallow:/customavatars/
Disallow:/customprofilepics/
Disallow:/images/
Disallow:/modcp/
Disallow:/ajax.php
Disallow:/attachment.php
Disallow:/calendar.php
Disallow:/cron.php
Disallow:/editpost.php
Disallow:/global.php
Disallow:/image.php
Disallow:/inlinemod.php
Disallow:/joinrequests.php
Disallow:/login.php
Disallow:/member.php
Disallow:/memberlist.php
Disallow:/misc.php
Disallow:/moderator.php
Disallow:/newattachment.php
Disallow:/newreply.php
Disallow:/newthread.php
Disallow:/online.php
Disallow:/poll.php
Disallow:/postings.php
Disallow:/printthread.php
Disallow:/private.php
Disallow:/profile.php
Disallow:/register.php
Disallow:/report.php
Disallow:/reputation.php
Disallow:/search.php
Disallow:/sendmessage.php
Disallow:/showgroups.php
Disallow:/subscription.php
Disallow:/threadrate.php
Disallow:/usercp.php
Disallow:/usernote.php

    
#Begin Attracta SEO Tools Sitemap. Do not remove
sitemap: http://cdn.attracta.com/sitemap/3406644.xml.gz
#End Attracta SEO Tools Sitemap. Do not remove

#Begin Attracta SEO Tools Sitemap. Do not remove
sitemap: http://cdn.attracta.com/sitemap/3406643.xml.gz
#End Attracta SEO Tools Sitemap. Do not remove
Shall I remove what Google Adsense says to move? How should my robot.txt file look?

I use vBSEO so not sure if I should do something via that in the AdminCP or if I should edit the robot.txt file manually.

Thanks all.
Reply With Quote
 

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 10:11 PM.


Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.03380 seconds
  • Memory Usage 2,256KB
  • Queries Executed 12 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)ad_showthread_beforeqr
  • (3)bbcode_code
  • (1)footer
  • (1)forumjump
  • (1)forumrules
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (1)navbar
  • (3)navbar_link
  • (120)option
  • (2)post_thanks_box
  • (2)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (2)post_thanks_postbit_info
  • (2)postbit
  • (2)postbit_onlinestatus
  • (2)postbit_wrapper
  • (1)showthread_list
  • (1)spacer_close
  • (1)spacer_open
  • (1)tagbit_wrapper 

Phrase Groups Available:
  • global
  • inlinemod
  • postbit
  • posting
  • reputationlevel
  • showthread
Included Files:
  • ./showthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_threadedmode.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_postinfo_query
  • fetch_postinfo
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showthread_start
  • showthread_getinfo
  • forumjump
  • showthread_post_start
  • showthread_query_postids_threaded
  • showthread_threaded_construct_link
  • showthread_query
  • bbcode_fetch_tags
  • bbcode_create
  • showthread_postbit_create
  • postbit_factory
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • fetch_musername
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • tag_fetchbit_complete
  • forumrules
  • navbits
  • navbits_complete
  • showthread_complete