PDA

View Full Version : Robots file !!! ?


Winter Sonata
07-20-2010, 03:13 PM
Hi , I need to prevent all universal bots from visiting my site or index it for sure except Google I want to allow google bots only so I edited my robots file to :


User-agent: Googlebot
Disallow: /vb/admincp/
Disallow: /vb/clientscript/
Disallow: /vb/cpstyles/
Disallow: /vb/customavatars/
Disallow: /vb/customprofilepics/
Disallow: /vb/images/
Disallow: /vb/modcp/
Disallow: /vb/ajax.php
Disallow: /vb/attachment.php
Disallow: /vb/calendar.php
Disallow: /vb/cron.php
Disallow: /vb/editpost.php
Disallow: /vb/global.php
Disallow: /vb/image.php
Disallow: /vb/inlinemod.php
Disallow: /vb/joinrequests.php
Disallow: /vb/login.php
Disallow: /vb/member.php
Disallow: /vb/memberlist.php
Disallow: /vb/misc.php
Disallow: /vb/moderator.php
Disallow: /vb/newattachment.php
Disallow: /vb/newreply.php
Disallow: /vb/newthread.php
Disallow: /vb/online.php
Disallow: /vb/poll.php
Disallow: /vb/postings.php
Disallow: /vb/printthread.php
Disallow: /vb/private.php
Disallow: /vb/profile.php
Disallow: /vb/register.php
Disallow: /vb/report.php
Disallow: /vb/reputation.php
Disallow: /vb/search.php
Disallow: /vb/sendmessage.php
Disallow: /vb/showgroups.php
Disallow: /vb/subscription.php
Disallow: /vb/threadrate.php
Disallow: /vb/usercp.php
Disallow: /vb/usernote.php
Allow: /

User-agent: *
Disallow: /







Is the changed I made right ? or sth should be added ??


Thanks

--------------- Added 1279672615 at 1279672615 ---------------

any help pls ?

--------------- Added 1279694360 at 1279694360 ---------------

:( Please help