Quote:
Originally Posted by soundbarrierpro
Oh, I don't want to get rid of them, I want them to stop trying to register.
|
disallow them from register.php, by listing this in your robots.txt
Here's what I have listed in my robots.txt file:
Disallow: /calendar.php
Disallow: /editpost.php
Disallow: /member.php
Disallow: /memberlist.php
Disallow: /misc.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /printthread.php
Disallow: /private.php
Disallow: /register.php
Disallow: /report.php
Disallow: /search.php
Disallow: /showgroups.php
Disallow: /usercp.php
Disallow: /admincp/
Disallow: /modcp/
Disallow: /online.php
Disallow: /subscription.php
Disallow: /threadrate.php
Disallow: /poll.php
Disallow: /attachment.php
Disallow: /avatar.php
Disallow: /faq.php
Disallow: /usercp.php
Disallow: /profile.php
User-agent: Custo
Disallow: /
User-agent: Slurp
Crawl-delay: 10