vBulletin Google Site Map

There are a few vBulletin Google Site maps around, but none as comprehensive as this that I have seen. This vBulletin Google site map is based on Kalius's work on discussed on his site and at Digitalpoint

FYI, the vBulletin Google Site Map modification contains at least one potential remote file include exploit. You are hereby notified that you should uninstall this modification, including the removal of the vBulletin Google Site Map PHP files from your server. The author of the modification has been notified, and the vBulletin Google Site Map thread has been moved to the Modification Graveyard forum.

Best,
vBorg Staff

vBulletin Google site map
with ability to add extra urls
(c) by T2DMan - Michael Brandon

8Nov05+13hrsGMT - update. Added support for Yahoo Sitemap & bug fix
7Nov05+13hrsGMT - update. Thanks for your help.

I have attached 1 version with 2 different preset configs for your convenience. vBSEO and non vBSEO configs.

Configure in the vbgsitemap-config.php file.
$base=""; // "" if in root, $base="forum/"; //if in the subdirectory forum

It now works well with forum permissions, and the vBulletin's scheduled task system. I have personally installed the reviewed vBGSiteMap on a site with over 200,000 urls. Copes with the large number of urls with no problems.

The vBGSiteMap works well with vbSEO, and it lists all the old url's to allow Google to spider the old url's and so find the 301 redirects to the new, and so delete the old url's from its index.

Compared to the previous versions

• Sitemap files now written into their own directory - means this can be safely chmod 777 - thanks Sarah King
• config and class files separated out
• new help file written
• many corrections made to the code - amazing what sitting on a piece of code can do, and amazing what you can learn from personally installing on many different servers.
• Can now work on mysql versions from 3.23.58 to 5+
  

Specifications

• works with v3.03 - 3.5
• access to this file is password protected

the same password as the database via the vBulletin includes/config.php file

• creates an index file and multiple gzipped site maps to less than the maximum permitted by Google (I have in fact restricted it to 3k url's, rather than 50k as my browser takes a while to process the file when checking it)
• creates a gzipped file containing the urls for Yahoo Sitemap

• the site map files are created in the /vbgsitemap/files directory which needs to be chmod to 777

adds

• forums - with paginations of forums (excluding redirects and password protected forums)
• threads - with pagination of threads (excluding invisible threads=soft deleted, and threads inside password protected forums)
• archive forum pages with paginations
• archive versions of threads with paginations
• members

extra

• extra urls from other program types
• add a new url per line onto file.txt, and a gzipped file will be created for it, and added to the site index file.

How to install

• unzip the files
• copy the vbgsitemap folder to your root directory
• chmod the vbgsitemap/files directory to 777
• copy vbgsitemap.php to your root directory
• copy the includes/cron/vbgsitemap-cron.php file to your vbulletin includes/cron/ directory
• look over the configuration options on the /vbgsitemap/vbgsitemap-config.php file
  • $base="" or "forum/" - if your forum is the actual root, or in the forum directory etc.
  • $addthreadarchive=false; - whether you want the archive version of the threads to be added or not.
  • the rest should not need to be changed
  • change to $xtrafile="file.txt"; if you have additional urls that you want included from another package, get a list of those url's and add them to file.txt.
• Then access the /vbgsitemap/index.php file in your browser to get things happening.
• The username/password is the username/password of your database.
• Add the resulting one index file to Google sitemaps: http://www.yourdomain.com/vbgsitemap.php
• Add the other file to Yahoo sitemaps
  http://www.yourdomain.com/vbgsitemap/files/urllist.gz
• A cron job can be setup in the vbulletin scheduled tasks
  
  
  • ./includes/cron/vbgsitemap-cron.php
  • depending on the number of posts/new threads to your forum, set to run daily or weekly etc. The cron will automatically ping Google and return success/failure into the cron log.

[mr2forums]

OKay, as far as the error im getting I think it's because the xml file is missing the </sitemapindex> on line 14. Is this a glitch in your script? I already modified the script;

fwrite( $multihandle, "<sitemap>
<loc>{$home}{$xtrafilegz}</loc>
<lastmod>{$a}</lastmod>
</sitemap>
");

}
//end xtra file

fwrite( $multihandle, "<sitemap>
<loc>{$home}{$file}</loc>
<lastmod>{$a}</lastmod>
</sitemap>
</sitemapindex>
");

At line 196 I added </sitemapindex> Which seemed to cure the problem.

[Reeve of shinra]

Eagle Creek: You can use this on vb 3.0.7 as well (I am). There are no screen shots really, what it does it is generates (and gzips) xml files of your forums threads in the google site map format. It will also generate an index file of the XML files generated which you submit to google. Google uses this site map to more efficiently spider your site.

Gary King: Sorry I wasnt clear enough. Type in www.yoursite.com/vbsitemap-multi.php and hit enter to run it. It will then generate the files. You'll need to add vbsitemap-multi.php to a cron job to have it updated at regular intervals.

[Eagle Creek]

Originally Posted by Reeve of shinra

Eagle Creek: You can use this on vb 3.0.7 as well (I am). There are no screen shots really, what it does it is generates (and gzips) xml files of your forums threads in the google site map format. It will also generate an index file of the XML files generated which you submit to google. Google uses this site map to more efficiently spider your site.

Gary King: Sorry I wasnt clear enough. Type in www.yoursite.com/vbsitemap-multi.php and hit enter to run it. It will then generate the files. You'll need to add vbsitemap-multi.php to a cron job to have it updated at regular intervals.

Hmm; maybe I will try it out then.

Thx.

[Neo541]

Originally Posted by Reeve of shinra

You'll need to add vbsitemap-multi.php to a cron job to have it updated at regular intervals.

Works great! When I added it to my scheduled tasks, it just brought up the page, and I had to manually click enter. Any pointers (or pages I should look at) that would explain how to make this into a cron job?

Thanks!

[Reeve of shinra]

I'd probably just wait until time2dine releases the next version which should be out in the not to distance future. It may have that as a feature.

[T2DMan]

Setting it up for a cron job... something I will have a look at. I am away for the next week though. Sorry.

[T2DMan]

Set up the running of the file as a cron job with the url in the following format. Substitute the DOMAIN.COM, USERNAME and PASSWORD with the actual domain, username and password.

http://www.DOMAIN.COM/vbsitemap-mult...WORD&ping=true

Try it on your browser first to see that it works, then have it as a cron.

[mute]

Originally Posted by clearchannel

I downloaded the zip file, and the readme is blank.

I'm having a little trouble with this. When I run it, my xml files all end up looking something like:

<loc>http://www.site.comwww1.site.com/whatever</loc>

I have multiple loadbalanced webservers, and therefore I am running this on one of our boxes (the www1.site.com one), but it's messing up all the urls in my files. I tried doing a little ereg_replace action in the scripts, but there's so many different urls I sort of gave up.

Any ideas?

Oh also, is there the ability to put this in a dir off of the site root? I'm not keen on having so many files hanging out in root..

[jarosciak]

I have installed and configured the files and I am trying to log in with my administrator account.
It won't work.
Constantly getting an error:
Incorrect username/password
And I've even typed it to notepad and copy/pasted it, just to make sure I am not typing it wrong.
Won't work for this hack. But no problems whatsoever logging into my forum with the same name and password.
What can I do about it?
Joe

[jarosciak]

Never Mind. I fixed it.
Joe