Quote:
Originally posted by TECK
Hmmmmmm... I'm really pissed... you see the [high]crawler918.com[/high] in the pic above?
That's a spy. Read more here about it.
To block the scums, add onto htaccess.txt file, at the top, this information:
Code:
<limit GET>
order allow,deny
deny from 12.148.196.
deny from 12.148.209.
allow from all
</limit>
then upload the file and rename it to .htaccess
That will block them for good, damn crooks.
|
deny from 12.148.196.
deny from 12.148.209.
those deny's block more that just the monkeys at crawler918.com
my limit section in htaccess looks like:
cyveillance do roughly the same thing as nameproctect
also in my robots.txt i've got:
# allow everyone else
User-agent: *
Disallow:
# block turnitin.com
User-agent: TurnitinBot
Disallow: /
www.turnitin.com might be a good cause for teachers - but they charge for accessing the data they've collected - so i'd rather not have them using my bandwidth/server load for free. So they can stay off my site until they decide to give a little back.