please verify robots.txt - much appreciated

[JIMRANGERS]

User-agent: Baiduspider
Disallow: /

User-agent: BoardTracker
Disallow: /

User-agent: Gigabot
Disallow: /

User-agent: Twiceler
Disallow: /

User-agent: Slurp
Crawl-delay: 2

User-agent: msnbot
Crawl-delay: 2

User-agent: *
Disallow: *.js
Disallow: /clientscript/
Disallow: /cpstyles/
Disallow: /customavatars/
Disallow: /customprofilepics/
Disallow: /images/
Disallow: /ajax.php
Disallow: /attachment.php
Disallow: /calendar.php
Disallow: /cron.php
Disallow: /editpost.php
Disallow: /global.php
Disallow: /image.php
Disallow: /inlinemod.php
Disallow: /joinrequests.php
Disallow: /login.php
Disallow: /member.php
Disallow: /memberlist.php
Disallow: /misc.php
Disallow: /moderator.php
Disallow: /newattachment.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /online.php
Disallow: /poll.php
Disallow: /post.php
Disallow: /postings.php
Disallow: /printthread.php
Disallow: /private.php
Disallow: /profile.php
Disallow: /register.php
Disallow: /report.php
Disallow: /reputation.php
Disallow: /search.php
Disallow: /sendmessage.php
Disallow: /showgroups.php
Disallow: /showpost.php
Disallow: /subscription.php
Disallow: /threadrate.php
Disallow: /usercp.php
Disallow: /usernote.php

Sitemap: http://yoursitessitemap.php

thanks in advance, was given this robot.txt from other vbulletin site but im not sure its correct as lots of URLs are being locked out according to google. Is this good or bad?

[JIMRANGERS]

sorry if its a bet technical, but cant find any answers on any forums

[Macsee]

Have you tried any of the robots.txt checking tools e.g. tool.motoricerca.info/robots-checker.phtml

You could also search in Google for robots.txt validator, there are several good ones.

On the face of it, yours looks OK. I usually also add

Disallow: /referrers.php

and, for SEO reasons

Disallow: /archive/

[JIMRANGERS]

Merry xmas all;

can someone explain why the /showpost.php should not be allowed, Im baffled on that one.

[Boofo]

Originally Posted by Macsee

Have you tried any of the robots.txt checking tools e.g. tool.motoricerca.info/robots-checker.phtml

You could also search in Google for robots.txt validator, there are several good ones.

On the face of it, yours looks OK. I usually also add

Disallow: /referrers.php

and, for SEO reasons

Disallow: /archive/

There is no referrers.php file in 4.1.8.