Well, it seemed to work, but then I started noticing some of the spiders were allowed and some were not. I haven't figured that one out yet, but in the process of the testing I managed to get my Google PR cut in half. I'm waiting for that to build back up, plus I am going to try this on a site that doesn't really matter about the PR. So if I do figure out anymore, then I will post an update.
|