vBulletin Google Site Map

There are a few vBulletin Google Site maps around, but none as comprehensive as this that I have seen. This vBulletin Google site map is based on Kalius's work on discussed on his site and at Digitalpoint

FYI, the vBulletin Google Site Map modification contains at least one potential remote file include exploit. You are hereby notified that you should uninstall this modification, including the removal of the vBulletin Google Site Map PHP files from your server. The author of the modification has been notified, and the vBulletin Google Site Map thread has been moved to the Modification Graveyard forum.

Best,
vBorg Staff

vBulletin Google site map
with ability to add extra urls
(c) by T2DMan - Michael Brandon

8Nov05+13hrsGMT - update. Added support for Yahoo Sitemap & bug fix
7Nov05+13hrsGMT - update. Thanks for your help.

I have attached 1 version with 2 different preset configs for your convenience. vBSEO and non vBSEO configs.

Configure in the vbgsitemap-config.php file.
$base=""; // "" if in root, $base="forum/"; //if in the subdirectory forum

It now works well with forum permissions, and the vBulletin's scheduled task system. I have personally installed the reviewed vBGSiteMap on a site with over 200,000 urls. Copes with the large number of urls with no problems.

The vBGSiteMap works well with vbSEO, and it lists all the old url's to allow Google to spider the old url's and so find the 301 redirects to the new, and so delete the old url's from its index.

Compared to the previous versions

• Sitemap files now written into their own directory - means this can be safely chmod 777 - thanks Sarah King
• config and class files separated out
• new help file written
• many corrections made to the code - amazing what sitting on a piece of code can do, and amazing what you can learn from personally installing on many different servers.
• Can now work on mysql versions from 3.23.58 to 5+
  

Specifications

• works with v3.03 - 3.5
• access to this file is password protected

the same password as the database via the vBulletin includes/config.php file

• creates an index file and multiple gzipped site maps to less than the maximum permitted by Google (I have in fact restricted it to 3k url's, rather than 50k as my browser takes a while to process the file when checking it)
• creates a gzipped file containing the urls for Yahoo Sitemap

• the site map files are created in the /vbgsitemap/files directory which needs to be chmod to 777

adds

• forums - with paginations of forums (excluding redirects and password protected forums)
• threads - with pagination of threads (excluding invisible threads=soft deleted, and threads inside password protected forums)
• archive forum pages with paginations
• archive versions of threads with paginations
• members

extra

• extra urls from other program types
• add a new url per line onto file.txt, and a gzipped file will be created for it, and added to the site index file.

How to install

• unzip the files
• copy the vbgsitemap folder to your root directory
• chmod the vbgsitemap/files directory to 777
• copy vbgsitemap.php to your root directory
• copy the includes/cron/vbgsitemap-cron.php file to your vbulletin includes/cron/ directory
• look over the configuration options on the /vbgsitemap/vbgsitemap-config.php file
  • $base="" or "forum/" - if your forum is the actual root, or in the forum directory etc.
  • $addthreadarchive=false; - whether you want the archive version of the threads to be added or not.
  • the rest should not need to be changed
  • change to $xtrafile="file.txt"; if you have additional urls that you want included from another package, get a list of those url's and add them to file.txt.
• Then access the /vbgsitemap/index.php file in your browser to get things happening.
• The username/password is the username/password of your database.
• Add the resulting one index file to Google sitemaps: http://www.yourdomain.com/vbgsitemap.php
• Add the other file to Yahoo sitemaps
  http://www.yourdomain.com/vbgsitemap/files/urllist.gz
• A cron job can be setup in the vbulletin scheduled tasks
  
  
  • ./includes/cron/vbgsitemap-cron.php
  • depending on the number of posts/new threads to your forum, set to run daily or weekly etc. The cron will automatically ping Google and return success/failure into the cron log.

[Cedric_FP]

Do we add that code to the bottom or..?

[NeutralizeR]

Thanks, working now

[Cedric_FP]

Originally Posted by NeutralizeR

Thanks, working now

What did you do to get it working?

[NeutralizeR]

(See my next post)

[Cedric_FP]

I have uploaded your fixes, and i am still getting

Fatal error: Call to undefined function: vbseo_get_options() in /home/fiction/public_html/vbgsitemap/index.php on line 358

[NeutralizeR]

Try replacing your files in vbgsitemap/ folder with these one.

Change necessary lines in vbgsitemap-config.php for your forum.

(I'm gonna remove the attachment when T2DMan releases the update)

[Cedric_FP]

It worked. Thanks a lot Neutralizer

[Disi]

hI t2d

got news for you

SELECT count( `vb_thread`.threadid ) 
FROM `vb_thread` , `vb_forum` 
LEFT JOIN `vb_forumpermission` ON `vb_thread`.`forumid` = `vb_forumpermission`.`forumid` 
AND `vb_forumpermission`.`usergroupid` =1
WHERE `vb_thread`.`visible` =1
AND vb_thread.`forumid` = vb_forum.`forumid` 
AND (
mod( mod( mod( mod( mod( mod( mod( mod( mod( mod( mod( mod( mod( mod( mod( mod( mod( forumpermissions, 262144 ) , 131072 ) , 65536 ) , 32768 ) , 16384 ) , 8192 ) , 4096 ) , 2048 ) , 1024 ) , 512 ) , 256 ) , 128 ) , 64 ) , 32 ) , 16 ) , 8 ) , 4 ) =3
OR forumpermissions =0
OR forumpermissions IS NULL 
)
AND `vb_forum`.`password` = ''
AND (
`options` /2 & lt ; & gt;

ceiling( `options` /2 ) 
) AND `vb_thread`.`forumid` = '3'

results in

#1054 - Unknown column 'vb_thread.forumid' in 'on clause'

[Unexplained.tv]

Works fine with no errors at all.

[Smitty]

Tried this and the script ran OK - BUT, when clicking on a link, I get "Fatal error: Call to a member function on a non-object in /usr/local/www/data-dist/includes/config.php on line 202" every time.

What am I missing in all this?

Running: vB 3.5.1
Server Type FreeBSD
Data Usage 159.47 MB
Web Server Apache v2.0.53
Index Usage 61.69 MB
PHP 4.3.10
Attachment Usage 481.55 MB
PHP Max Post Size 16.00 MB
PHP Maximum Upload Size 2.00 MB
PHP Memory Limit 16.00 MB
MySQL Version 4.1.9
MySQL Packet Size 1.00 MB

EDIT ADD: IT Doesn't appear to be indexing all forums. Is there supposed to be a sitemap for each individual forum?