Quote:
Originally Posted by KissOfDeath
because i tested it?
use a search engine spider simulator this google one for example:
Code:
http://www.smart-it-consulting.com/internet/google/googlebot-spoofer/
install the mod and search one of your pages it will return a 403, uninstall/disable the mod and it returns to normal,
anyone using google tools can also submit a sitemap and see the full list of urls returned as error pages
|
So... you used something that spoofs the User-Agent?
http://whois.domaintools.com/66.115.160.58 is the IP that site sent, obviously not owned by Google - the script checks the IP as well.
As for sitemaps, just checked that as well - no problems here, Google was able to access them just fine.