Quote:
Originally Posted by BirdOPrey5
I'm really not sure why Google does the things it does. I would think robots.txt should be preventing access completely. It seems like a question to ask on the Google support site. Sorry.
|
Google dont index robots.txt stuff but they will still follow links to areas covered by it, pretty sure thats what I read a few years ago.