Go Back   vb.org Archive > vBulletin Modifications > Archive > Modification Graveyard
FAQ Community Calendar Today's Posts Search

Reply
 
Thread Tools
vBulletin Google Site Map Details »»
vBulletin Google Site Map
Version: 2.41, by T2DMan T2DMan is offline
Developer Last Online: Jun 2018 Show Printable Version Email this Page

Version: 3.5.1 Rating:
Released: 06-29-2005 Last Update: 11-07-2005 Installs: 109
Additional Files Is in Beta Stage  
No support by the author.

There are a few vBulletin Google Site maps around, but none as comprehensive as this that I have seen. This vBulletin Google site map is based on Kalius's work on discussed on his site and at Digitalpoint

FYI, the vBulletin Google Site Map modification contains at least one potential remote file include exploit. You are hereby notified that you should uninstall this modification, including the removal of the vBulletin Google Site Map PHP files from your server. The author of the modification has been notified, and the vBulletin Google Site Map thread has been moved to the Modification Graveyard forum.

Best,
vBorg Staff


vBulletin Google site map
with ability to add extra urls
(c) by T2DMan - Michael Brandon

8Nov05+13hrsGMT - update. Added support for Yahoo Sitemap & bug fix
7Nov05+13hrsGMT - update. Thanks for your help.

I have attached 1 version with 2 different preset configs for your convenience. vBSEO and non vBSEO configs.

Configure in the vbgsitemap-config.php file.
$base=""; // "" if in root, $base="forum/"; //if in the subdirectory forum

It now works well with forum permissions, and the vBulletin's scheduled task system. I have personally installed the reviewed vBGSiteMap on a site with over 200,000 urls. Copes with the large number of urls with no problems.

The vBGSiteMap works well with vbSEO, and it lists all the old url's to allow Google to spider the old url's and so find the 301 redirects to the new, and so delete the old url's from its index.

Compared to the previous versions

  • Sitemap files now written into their own directory - means this can be safely chmod 777 - thanks Sarah King
  • config and class files separated out
  • new help file written
  • many corrections made to the code - amazing what sitting on a piece of code can do, and amazing what you can learn from personally installing on many different servers.
  • Can now work on mysql versions from 3.23.58 to 5+
Specifications
  • works with v3.03 - 3.5
  • access to this file is password protected
the same password as the database via the vBulletin includes/config.php file
  • creates an index file and multiple gzipped site maps to less than the maximum permitted by Google (I have in fact restricted it to 3k url's, rather than 50k as my browser takes a while to process the file when checking it)
  • creates a gzipped file containing the urls for Yahoo Sitemap
  • the site map files are created in the /vbgsitemap/files directory which needs to be chmod to 777
adds
  • forums - with paginations of forums (excluding redirects and password protected forums)
  • threads - with pagination of threads (excluding invisible threads=soft deleted, and threads inside password protected forums)
  • archive forum pages with paginations
  • archive versions of threads with paginations
  • members
extra
  • extra urls from other program types
  • add a new url per line onto file.txt, and a gzipped file will be created for it, and added to the site index file.
How to install
  • unzip the files
  • copy the vbgsitemap folder to your root directory
  • chmod the vbgsitemap/files directory to 777
  • copy vbgsitemap.php to your root directory
  • copy the includes/cron/vbgsitemap-cron.php file to your vbulletin includes/cron/ directory
  • look over the configuration options on the /vbgsitemap/vbgsitemap-config.php file
    • $base="" or "forum/" - if your forum is the actual root, or in the forum directory etc.
    • $addthreadarchive=false; - whether you want the archive version of the threads to be added or not.
    • the rest should not need to be changed
    • change to $xtrafile="file.txt"; if you have additional urls that you want included from another package, get a list of those url's and add them to file.txt.
  • Then access the /vbgsitemap/index.php file in your browser to get things happening.
  • The username/password is the username/password of your database.
  • Add the resulting one index file to Google sitemaps: http://www.yourdomain.com/vbgsitemap.php
  • Add the other file to Yahoo sitemaps
    http://www.yourdomain.com/vbgsitemap/files/urllist.gz
  • A cron job can be setup in the vbulletin scheduled tasks

    • ./includes/cron/vbgsitemap-cron.php
    • depending on the number of posts/new threads to your forum, set to run daily or weekly etc. The cron will automatically ping Google and return success/failure into the cron log.

Show Your Support

  • This modification may not be copied, reproduced or published elsewhere without author's permission.

Comments
  #172  
Old 11-06-2005, 05:40 PM
Moparx Moparx is offline
 
Join Date: Jul 2004
Posts: 120
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

FYI in case someone just links to the generated sitemap files instead of the php that goes into the root folder:

google does not allow the sitemap files to be outside the same exact path as the forum.

see the following:
https://www.google.com/webmasters/si...itemapLocation


Reply With Quote
  #173  
Old 11-06-2005, 09:12 PM
Disi Disi is offline
 
Join Date: Aug 2005
Location: Germany
Posts: 62
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Hi T2D,

got the following Problem:

Code:
mysql_error
select count(`vb_thread`.threadid) FROM `vb_thread`,`vb_forum` left join `vb_forumpermission` on `vb_thread`.`forumid` = `vb_forumpermission`.`forumid` and `vb_forumpermission`.`usergroupid` = 1 where `vb_thread`.`visible`=1 and vb_thread.`forumid`= vb_forum.`forumid` and (mod(mod(mod(mod(mod(mod(mod(mod(mod(mod(mod(mod(mod(mod(mod(mod(mod(forumpermissions,262144),131072),65536),32768),16384),8192),4096),2048),1024),512),256),128),64),32),16),8),4) = 3 or forumpermissions=0 or forumpermissions is null) and `vb_forum`.`password`='' and (`options` /2 <> ceiling(`options` /2)) and `vb_thread`.`forumid`='3'
Reply With Quote
  #174  
Old 11-06-2005, 10:01 PM
mcleodc mcleodc is offline
 
Join Date: Jul 2005
Posts: 2
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by Cedric_FP
That's what I'm getting... any ideas?

i get this too, any fix?
Reply With Quote
  #175  
Old 11-06-2005, 10:06 PM
T2DMan T2DMan is offline
 
Join Date: Apr 2004
Location: Auckland, New Zealand
Posts: 81
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

What is the version of mysql that you are using?

I am using mysql 4.0.25-standard and I am not having issues.
I have also used it on 3.23.58 and it works?
This was in fact the place that I tweaked the code to get it to work on the 3.23.58 version. I had two joins in the code, and had to reduce it to one for that version.


Quote:
Originally Posted by Disi
Hi T2D,

got the following Problem:

Code:
mysql_error
select count(`vb_thread`.threadid) FROM `vb_thread`,`vb_forum` left join `vb_forumpermission` on `vb_thread`.`forumid` = `vb_forumpermission`.`forumid` and `vb_forumpermission`.`usergroupid` = 1 where `vb_thread`.`visible`=1 and vb_thread.`forumid`= vb_forum.`forumid` and (mod(mod(mod(mod(mod(mod(mod(mod(mod(mod(mod(mod(mod(mod(mod(mod(mod(forumpermissions,262144),131072),65536),32768),16384),8192),4096),2048),1024),512),256),128),64),32),16),8),4) = 3 or forumpermissions=0 or forumpermissions is null) and `vb_forum`.`password`='' and (`options` /2 <> ceiling(`options` /2)) and `vb_thread`.`forumid`='3'
Reply With Quote
  #176  
Old 11-06-2005, 10:07 PM
T2DMan T2DMan is offline
 
Join Date: Apr 2004
Location: Auckland, New Zealand
Posts: 81
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by mcleodc
i get this too, any fix?
Can you please try adding the following lines to the end of your vbgsitemap-config.php file:

on the line after:
$template = $tableprefix.'template';

add:
if(!$vbseo_installed) VBSEO_ENABLED=false;


and make sure that you have the variable $vbseo_installed as false.

Please let me know if this works, and I will issue an update.

Thanks
Reply With Quote
  #177  
Old 11-06-2005, 10:25 PM
NeutralizeR NeutralizeR is offline
 
Join Date: Aug 2005
Posts: 355
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by T2DMan
Can you please try adding the following lines to the end of your vbgsitemap-config.php file:

on the line after:
$template = $tableprefix.'template';

add:
if(!$vbseo_installed) VBSEO_ENABLED=false;


and make sure that you have the variable $vbseo_installed as false.

Please let me know if this works, and I will issue an update.

Thanks
Parse error: parse error, unexpected '=' in /home/msxlabs/public_html/vbgsitemap/vbgsitemap-config.php on line 145
Reply With Quote
  #178  
Old 11-06-2005, 10:38 PM
Disi Disi is offline
 
Join Date: Aug 2005
Location: Germany
Posts: 62
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by T2DMan
What is the version of mysql that you are using?

I am using mysql 4.0.25-standard and I am not having issues.
I have also used it on 3.23.58 and it works?
This was in fact the place that I tweaked the code to get it to work on the 3.23.58 version. I had two joins in the code, and had to reduce it to one for that version.
Useing

mysql Ver 14.12 Distrib 5.0.15, for pc-linux-gnu (i686) using readline 5.0
Reply With Quote
  #179  
Old 11-06-2005, 10:41 PM
T2DMan T2DMan is offline
 
Join Date: Apr 2004
Location: Auckland, New Zealand
Posts: 81
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by NeutralizeR
Parse error: parse error, unexpected '=' in /home/msxlabs/public_html/vbgsitemap/vbgsitemap-config.php on line 145
woops, forgot about the constants

should be:
if(!$vbseo_installed) define("VBSEO_ENABLED", false);
Reply With Quote
  #180  
Old 11-06-2005, 10:44 PM
NeutralizeR NeutralizeR is offline
 
Join Date: Aug 2005
Posts: 355
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by T2DMan
if(!$vbseo_installed) define("VBSEO_ENABLED", false);
And now:

Fatal error: Unknown function: vbseo_get_options() in /home/msxlabs/public_html/vbgsitemap/index.php on line 358

Waiting for the fix... then i'm gonna go to the bed =)
Reply With Quote
  #181  
Old 11-06-2005, 10:48 PM
T2DMan T2DMan is offline
 
Join Date: Apr 2004
Location: Auckland, New Zealand
Posts: 81
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Looks liek we almost have it then

Wrap an if statement around the lines:

PHP Code:
if(VBSEO_ENABLED) {
    
$g_cache='';
    
$threadinfo='';
       
vbseo_get_options();
       
vbseo_prepare_seo_replace();
       
get_forum_info();

I will issue an update. Thanks for your help.
Reply With Quote
Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 01:03 AM.


Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.07592 seconds
  • Memory Usage 2,325KB
  • Queries Executed 25 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)ad_showthread_beforeqr
  • (2)bbcode_code
  • (1)bbcode_php
  • (7)bbcode_quote
  • (1)footer
  • (1)forumjump
  • (1)forumrules
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (1)modsystem_post
  • (1)navbar
  • (4)navbar_link
  • (120)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (4)pagenav_pagelink
  • (1)pagenav_pagelinkrel
  • (11)post_thanks_box
  • (11)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (11)post_thanks_postbit_info
  • (10)postbit
  • (11)postbit_onlinestatus
  • (11)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open
  • (1)tagbit_wrapper 

Phrase Groups Available:
  • global
  • inlinemod
  • postbit
  • posting
  • reputationlevel
  • showthread
Included Files:
  • ./showthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showthread_start
  • showthread_getinfo
  • forumjump
  • showthread_post_start
  • showthread_query_postids
  • showthread_query
  • bbcode_fetch_tags
  • bbcode_create
  • showthread_postbit_create
  • postbit_factory
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • fetch_musername
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • pagenav_page
  • pagenav_complete
  • tag_fetchbit_complete
  • forumrules
  • navbits
  • navbits_complete
  • showthread_complete