Quote:
Originally Posted by the one
Already got it buddy i added these to it below but it dont work
us-west-2.compute.amazonaws.com
compute.amazonaws.com
amazonaws.com
compute-1.amazonaws.com
us-west-2.compute.amazonaws.com
.us-west-2.compute.amazonaws.com
Am i doing something wrong.Many thanks for any help on this.
|
I think you can just add amazonaws.com or amazonaws and it should work.. That should block all the amazon bots.
Did you add that to your robots.txt file too?
Disallow: amazonaws.com