Yes, i am guessing that you are right but from somebody that has very little idea, searching round for a good example doesn't really mean much..

Is it possible to provide a good example?

And also a bad example?

Thanks..............

Edit: I cannot find a robots.txt in my root directory, it isn't there..

I also do not have vbseo as a mod. If it is part of the vB 4.2.1 core, I wouldn't know that either...

If robots.txt isn't there create a new one. Good example can be found here:
https://vborg.vbsupport.ru/showthread.php?t=302570




vbSEO is not part of vB 4.2.1

Yes, I have been using vb for some time, and forgot robots.txt doesnt come with the bundle.

And yes, its no big deal to make one and uploasd to your root.
It is just a flat txt file anyway.

That is a good example.

And just append the sitemap url and reference to the header or footer.

I have submit it before 15 or 20 day ago, it was working fine but from last 7 days its showing said error

I for what ever reason decided to go to my manage domains page and just decided to click away to see how google was doing with crawling my site and such..

Well I noticed that for some reason google was saying that there is an error and was not able to crawl my site and forums as well as not being able to access the sitemap...

I believe its something to do with google themselves, I wouldn't worry to much about it, wait a few days maybe a couple of weeks and then see if they are still having problems with the sitemaps....

Please not, that was the issue with me it could of course be something completely different with you.

One more thing, make sure you add this to your robots.txt


User-agent: *
Allow: /
sitemap:http://www.yourdomain.com/path/to/your/sitemap-file


This instructs them to allow access to your sitemap at the path indicated here...

i have done this but still same problem in google webmaster

Quote:

Originally Posted by friendlymela (Post 2450384) i have done this but still same problem in google webmaster

There are some characters that Google does not like to see in sitemaps and will error out when trying to read them. vBSEO Sitemap should encode all urls correctly so this isn't an issue but I've have run across at least a couple characters that aren't coded correctly. Offhand I can't remember exactly the ones I've personally run into but I believe the ampersand was one of them ("&" should be changed to "&" in any url reference). I remember the ampersand was definitely an issue for me if it wasn't coded as "&" I ran across this error a couple times when I was adding urls to the "extra-urls.txt" file.

Whenever Google would give me a sitemap error, my solution was to check my latest sitemap manually and see if there was an odd character in any thread/post title url. Usually I would find one, then I would just go to the forum edit the thread title, recreate the sitemap and all was good.

Also, do not use all the settings in vbseo sitemap.

Indexing the "post" settings as on, may produce considerable 404 errors in webmaster tools. That settings will list incorrect url's in sitemaps. (I am using pretty urls)