Quote:
Originally Posted by jribz
Thanks for the reply, that clears up alot... I had to verify site ownership via google, the logs for the cron showed exactly that.
One thing I notice however, while looking now, is that the google spider is viewing a few regular threads, while the google adsense spider is viewing the archive, also viewing the archive is msnbot yahoslurp and askjeeves.
Wonder why google is seeing a regular thread now.
Going to look into the htaccess in a bit.
|
vB detects search engine by the following string:
google|msnbot|yahoo! slurp (in the init.php file)
Any user agent matchines that will be detected as search engine.
So check your http access log and see what user agent does 'Google' use. It should say "Googlebot".