Google Spider? why is it doing this?

[GraphiX2004]

Some admins reported to me today that our community is now seeing google spider.
when we look where the spider is viewing its normally search or a certain forum.

today i noticed the spider was on the site so i checked where it was viewing.
it was actually viewing a members profile page??? wtf

why would google spider bot be singling out a member's personal profile page?
i understand kind of why we have this google spider bot but cant we just turn it off?
or is this built into vbulletin so it's mandatory for search engines to sqirm all over our forum?

Any help how to get rid of the google spider or why its now singling out members
would really be helpful thanks guys. and girls.

[BlueNinjaGo]

It's indexing your site. So if someone searches "GraphiX2004" for example, it'll pull it up.

As far as I know, a spider bot can only view what a guest can view. So by stopping guests from viewing profiles it should stop it. But it's not really causing any harm.

[Cryo]

The point of a spider is to crawl through your pages and index them. If you want to prevent it from indexing your member pages I'd suggest reading this site (http://www.robotstxt.org/robotstxt.html). You can add a specific exception for member.php.

[Brandon Sheley]

add a line in your robots.txt file to exclude the profile pages
The bot is only doing what it was designed for ;)

[GraphiX2004]

ok guys thanks for the headups

[Biker_GA]

Also, if there was a stop sign associated with the entry, it means the spider was not able to index the page. No access.