Log in

View Full Version : google/yahoo sitemap gen question

hpidriver
10-06-2009, 11:44 PM
i have member profile set to Never, but i still see google bots indexing user profiles. Anyone know what could possibly be wrong?
kall
10-07-2009, 12:07 AM
The sitemap just suggests what to crawl.

To prevent things being crawled, you need to use .htaccess or similar.