vBulletin Google Site Map

There are a few vBulletin Google Site maps around, but none as comprehensive as this that I have seen. This vBulletin Google site map is based on Kalius's work on discussed on his site and at Digitalpoint

FYI, the vBulletin Google Site Map modification contains at least one potential remote file include exploit. You are hereby notified that you should uninstall this modification, including the removal of the vBulletin Google Site Map PHP files from your server. The author of the modification has been notified, and the vBulletin Google Site Map thread has been moved to the Modification Graveyard forum.

Best,
vBorg Staff

vBulletin Google site map
with ability to add extra urls
(c) by T2DMan - Michael Brandon

8Nov05+13hrsGMT - update. Added support for Yahoo Sitemap & bug fix
7Nov05+13hrsGMT - update. Thanks for your help.

I have attached 1 version with 2 different preset configs for your convenience. vBSEO and non vBSEO configs.

Configure in the vbgsitemap-config.php file.
$base=""; // "" if in root, $base="forum/"; //if in the subdirectory forum

It now works well with forum permissions, and the vBulletin's scheduled task system. I have personally installed the reviewed vBGSiteMap on a site with over 200,000 urls. Copes with the large number of urls with no problems.

The vBGSiteMap works well with vbSEO, and it lists all the old url's to allow Google to spider the old url's and so find the 301 redirects to the new, and so delete the old url's from its index.

Compared to the previous versions

• Sitemap files now written into their own directory - means this can be safely chmod 777 - thanks Sarah King
• config and class files separated out
• new help file written
• many corrections made to the code - amazing what sitting on a piece of code can do, and amazing what you can learn from personally installing on many different servers.
• Can now work on mysql versions from 3.23.58 to 5+
  

Specifications

• works with v3.03 - 3.5
• access to this file is password protected

the same password as the database via the vBulletin includes/config.php file

• creates an index file and multiple gzipped site maps to less than the maximum permitted by Google (I have in fact restricted it to 3k url's, rather than 50k as my browser takes a while to process the file when checking it)
• creates a gzipped file containing the urls for Yahoo Sitemap

• the site map files are created in the /vbgsitemap/files directory which needs to be chmod to 777

adds

• forums - with paginations of forums (excluding redirects and password protected forums)
• threads - with pagination of threads (excluding invisible threads=soft deleted, and threads inside password protected forums)
• archive forum pages with paginations
• archive versions of threads with paginations
• members

extra

• extra urls from other program types
• add a new url per line onto file.txt, and a gzipped file will be created for it, and added to the site index file.

How to install

• unzip the files
• copy the vbgsitemap folder to your root directory
• chmod the vbgsitemap/files directory to 777
• copy vbgsitemap.php to your root directory
• copy the includes/cron/vbgsitemap-cron.php file to your vbulletin includes/cron/ directory
• look over the configuration options on the /vbgsitemap/vbgsitemap-config.php file
  • $base="" or "forum/" - if your forum is the actual root, or in the forum directory etc.
  • $addthreadarchive=false; - whether you want the archive version of the threads to be added or not.
  • the rest should not need to be changed
  • change to $xtrafile="file.txt"; if you have additional urls that you want included from another package, get a list of those url's and add them to file.txt.
• Then access the /vbgsitemap/index.php file in your browser to get things happening.
• The username/password is the username/password of your database.
• Add the resulting one index file to Google sitemaps: http://www.yourdomain.com/vbgsitemap.php
• Add the other file to Yahoo sitemaps
  http://www.yourdomain.com/vbgsitemap/files/urllist.gz
• A cron job can be setup in the vbulletin scheduled tasks
  
  
  • ./includes/cron/vbgsitemap-cron.php
  • depending on the number of posts/new threads to your forum, set to run daily or weekly etc. The cron will automatically ping Google and return success/failure into the cron log.

[T2DMan]

Originally Posted by dsboyce8624

I also noticed that it misformed the URL, most likely because I had problems with it, but it ended up with the site main URL twice, then the rest of the address.

Please check your setup - the system picks up your domain. All you need to specify is the directory with a trailing forward slash. Or blank if your forum is in the root directory.

[PixelFx]

Originally Posted by T2DMan

Please check your setup - the system picks up your domain. All you need to specify is the directory with a trailing forward slash. Or blank if your forum is in the root directory.

this looks really cool, how well would it work with vbadvanced cmps 2.0 custom vba pages?

[David_R]

how exactly should i use this hack ?

[T2DMan]

How do I use

I have now added instructions on how to setup - please see this thread.

vBAdvanced

With custom vbadvanced pages, you can manually add pages to the file specified and the program will add them to the Google site map. Or you can amend the file to drag the vbadvanced urls from the database and add them to the site map as well.

If you do manage to hack the file for vBAdvanced, please post the code here and a sample of the xml file, and I will add the code to the program.

[clearchannel]

I downloaded the zip file, and the readme is blank.

[T2DMan]

This thread includes the installation instructions
https://vborg.vbsupport.ru/showthread.php?t=91389

In addition, you should be able to read through the start of the vbsitemap-multi.php file to see the config options.

The blank file.txt is to add additional url's manually.

[Mickie D]

im having problems with this

it created the files no problem but when i click on one of the sitemap pages (i have 106000 generated)

i get this error

The XML page cannot be displayed
Cannot view XML input using style sheet. Please correct the error and then click the Refresh button, or try again later.

--------------------------------------------------------------------------------

An invalid character was found in text content. Error processing resource 'http://www.world-of-digital.com/sitemap6.xml.gz'...

[T2DMan]

For some strange reason, when I look at it there is no problem.

I get the correct response "
This XML file does not appear to have any style information associated with it."

Your error says that it can't use the style sheet - so disable the style sheet and you should be right???

Originally Posted by Mickie D

im having problems with this
...
i get this error

The XML page cannot be displayed
Cannot view XML input using style sheet. Please correct the error and then click the Refresh button, or try again later.



[Mickie D]

where do i disble the style sheet ?

is it the css stored as files i need to disable ?

if so im sure it would be better to work around this because the style sheet increases speed and bandwidth on my site by 40% with tursk mmchache installed!

but if your not talking about that option then pay no attention to my post m8

would love this working i jsut stumbled across the sitemap feature in google and done a few searches and nearly every result i have read has been positive !!!!

cheers for releasing this aswell

update:

i just disabled the stylesheet css stored as files option and still the same error (yes i done a ctrl F5 refresh aswell)

[T2DMan]

Sorry, you have got me slightly wrong there. You definately need CSS stored as files on your vBulletin site. So change that back fast!

The xml file you have, has nothing wrong with it - its the way that you are reading it that is the issue.

The issue is to do with your browser and how it views specifically the xml files (nothing to do with vBulletin per say). When I personally look at the file you mention, I am able to view it with no problems. I get the notation at the top

This XML file does not appear to have any style information associated with it.

However, when you look at it, you get

Cannot view XML input using style sheet

How are you looking at the xml file??? - I personally use firefox, but even with explorer, I see no error. I personally am not using an xml reader, nor am I attempting to display the xml in any other format other than what it is.