Quote:
Originally Posted by FRDS
you dont need any other than the public_html folder, they aren't hurting anything being in different locations to my knowledge, but they are just useless.
If the paths are correct and the yahoo spider is still going insane, try to run your robots.txt thru a robots.txt generator or checker (many available free online) to make sure there are no errors.
After that, i dont have a clue of why Yahoo isn't picking it up.
|
Thank you. I will try that.
EDIT: There were errors. I should have had an empty line between each block of code. I fixed it. Hope that was the problem.