I'm getting the following error from Google, after I submit the sitemap:

Your Sitemap exceeds the maximum file size limit. Please create multiple Sitemaps containing fewer URLs to meet the file size limit

This is using 50,000 entries per page (we have about 6 million URLs to index)

Is there any update on VB 3.8 for this MOD????

I have installed the latest version (3.2.0)

Great! Works fine on my vb 3.8 gold.

Thx very much.

Anyone?

I must be stupit or somthing. My browser shows no download link to this. Can someone please tell me where it is?

skip that, I found it.

Hi, I am getting this odd error, after upgrading to php5

Before you tell me to increase the php memory limit, please notice that it is set to 512MB already, and it is only trying to allocate 141.5 MB to run the script.

Please try to:
- disable text sitemap option
- remove existing *.gz files from data/ folder
- regenerate sitemap

i have 3.8 but it doesn't extract forums or topic links

see the last report

http://img210.imageshack.us/img210/4373/77985750sl9.jpg

any help? thanks

Thanks.

Do you know what the max size per file is for Google? Mine are all around 4MB, but are being rejected by Google.

Looking at the report, it shows the google index url pointing to http://www.example.com/forum/sitemap_index.xml.gz but if I look in the same directory using FTP, it's not there. Do I need to change a setting somewhere?

hscorp,

are your subforums open for guest visitors? (otherwise search engines will not be able to view them, and they are automatically excluded from sitemap)

lowlight,

maximum file size if 10Mb. What exactly is the error message you get?

cooltechie,

files are stored in vbseo_sitemap/data/ folder, but you can access them via forums root using rewrite rule entered in .htaccess file.

I'm using mod that allow search engine to access the forum and prevent the guests

so how can i make the sitemap include the links?

regards

Hi;
When I Run Sitemap I gives me Error;

Database error in vBulletin 3.8.0:

Invalid SQL:

SELECT *
FROM vbthread AS thread
WHERE forumid = 3
AND visible = 1
AND pollid > 0;

MySQL Error : MySQL server has gone away
Error Number : 2006
Request Date : Thursday, January 29th 2009 @ 12:09:58 AM
Error Date : Thursday, January 29th 2009 @ 12:23:50 AM
Script : http://www..com/vbseo_sitemap/vbseo_sitemap.php
Referrer : http://www..com/vbseo_sitemap/
IP Address : 88.231.140.146
Username : Kayıtsız
Classname : vB_Database
MySQL Version :

Please Help.
Thanks...

Are these part of the instructions? I'm sure I followed everything but can't figure out why it would point there when in fact the files are stored elsewhere. The bots didn't make one download which was why I looked there. Kindly point me in the right direction.

In the AdminCP settings for this mod, one of the options is "Max URLs in Sitemap Files." In the description it says "Google allows no more than 50,000 URLs per file." What happens if my site starts getting over 50,000 URL's?? If I leave the default setting at 20,000 what will happen when I get to 20,000? Does it just start making a new sitemap file, or do I lose old links in the sitemap?

I hope that question makes sense...

Thanks!

hscorp,

that is cloaking, that's why those URLs are not included in sitemap.


O'NEAL,

you should increase wait_timeout setting in MySQL configuration.


cooltechie,
> Are these part of the instructions?
yes:
joe1989,

it will just split sitemap on multiple files in this case.

So all the links will still be found by the crawler bots?

I triple checked and verified that the line is there. Since I had an existing .htaccess, I simply cut and pasted the line you have in the htaccess.txt file. I can access the report details but not the linked gz file.

edit: I renamed my htaccess and uploaded the one you have and it works. My guess is the bad bots list is conflicting with yours.

I looked but didn't see this question. What's the advantage, or is there an advantage, of the paid vbSEO over this SEO plug in?

Thanks

joe1989,

yes, exactly.


cooltechie,

please post your complete .htaccess so that we can find the conflicting directives.


niteflyer32,

this mod just creates XML sitemap for your forum, while vBSEO is a complete SEO add-on for vBulletin (including URL rewrites, links consolidation etc): http://www.vbseo.com

I manually ran the task and got this:

Check this please: http://www.vbseo.com/f67/error-durin...50/#post190403

Hi,

do I need vbSEO for this Mod?

Greetings,
Benny

No, vBSEO product is not required to run "vBSEO Sitemap Generator".

Im getting the error in revision history step 7 as above.

Ive been away for a few months and noticed when checking my sitemaps that i have not generated a sitemap since may last year

Are you running vBSEO as well? If yes, you need v3.2.0 or greater to use "Smart priority" option in sitemap generator.

When our cron job runs automatically in the middle of the night to update the sitemap, it will get say 20,000 URLs generated. However, when we run it manually from scheduled tasks, it will generate an additional 4000-5000 URLs for a total of somewhere between 24,000 and 25,000. It's random how many additional it will get from the previous scheduled run but it's always in the thousands of new URLs.

What could possibly be the cause of this sillyness?

Thanks!
Buster

You should not run it manually in Scheduled tasks manager since that executes it with admin privileges and links to private subforums are included in sitemap as a result. You can manually create sitemap in vbseo_sitemap/ interface though.

Makes perfect sense. Thanks for the tip. Re-ran it the way you suggested to get it updated.

I have another question. I noticed in a lot forums that many people submit multiple sitemaps for one domain URL like sitemap_1, sitemap_2, sitemap_3, etc.. What is the purpose of this and are they getting a whole differnet set of URLs?

Thanks!
Buster

You should only submit sitemap_index.xml.gz - it includes links to all your sitemap files (sitemap_X.xml.gz)

Well when I look in that file, all it shows is sitemap_1.xml.gz. So what's the difference? I guess I don't understand the purpose of multiple sitemap files. I also don't see what generates multiple ones since the sitemap generator only creates one by default.

Is there some advantage to multiple ones and if so, what do the differnet ones point to differently than just one?

Thanks for any insight you can provide.

Buster

In case if you have many URLs vBSEO Sitemap Generator will separate them on multiple file (default setting is 20,000 URLs max per file).

I keep running the generate link from the control panel and it says that everything ran fine. But when I go through FTP to the site the files it said it created are nowhere to be found.

Here is the output it gives me:



But again when I go looking for the sitemaps it said it created I cannot locate them. A click on the link to view the google and yahoo ones just gives a 404 error.



Here is my .htaccess file:

What exactly is your sitemap URL?
Try to change this line:
RewriteCond %{REQUEST_URI} !(admincp/|modcp/|cron)
to:
RewriteCond %{REQUEST_URI} !(admincp/|modcp/|cron|vbseo_sitemap/)

It worked! :) thank you iojam!!

Now when I visit the forum in firefox there are no google adsense ads anywhere to be found. Would this sitemap generator affect the ads in the pages?

here the the forum:
http://forum.horseville.com

the is the page for example:
http://forum.horseville.com/intros/1...ggestions.html
When viewed with IE it shows the ads, when viewed with firefox no ads are to be found.

will this work with 3.8.0

Solved my problem too... good work.

First off the fix for vb 3.8.2 as the group changes break the base code:-
Next up we are getting a load of garbage in our sitemap even the zcat cant read the files:-
Even some of the files that can be decompress are corrupt internally with invalid xml e.g. the data of the lastmod appearing in the url and missing close tags all over.

Has anyone seen this sort of corruption before?

We are running the following:-