Go Back   vb.org Archive > vBulletin Modifications > Archive > Modification Graveyard
FAQ Community Calendar Today's Posts Search

Reply
 
Thread Tools
vBulletin Google Site Map Details »»
vBulletin Google Site Map
Version: 2.41, by T2DMan T2DMan is offline
Developer Last Online: Jun 2018 Show Printable Version Email this Page

Version: 3.5.1 Rating:
Released: 06-29-2005 Last Update: 11-07-2005 Installs: 109
Additional Files Is in Beta Stage  
No support by the author.

There are a few vBulletin Google Site maps around, but none as comprehensive as this that I have seen. This vBulletin Google site map is based on Kalius's work on discussed on his site and at Digitalpoint

FYI, the vBulletin Google Site Map modification contains at least one potential remote file include exploit. You are hereby notified that you should uninstall this modification, including the removal of the vBulletin Google Site Map PHP files from your server. The author of the modification has been notified, and the vBulletin Google Site Map thread has been moved to the Modification Graveyard forum.

Best,
vBorg Staff


vBulletin Google site map
with ability to add extra urls
(c) by T2DMan - Michael Brandon

8Nov05+13hrsGMT - update. Added support for Yahoo Sitemap & bug fix
7Nov05+13hrsGMT - update. Thanks for your help.

I have attached 1 version with 2 different preset configs for your convenience. vBSEO and non vBSEO configs.

Configure in the vbgsitemap-config.php file.
$base=""; // "" if in root, $base="forum/"; //if in the subdirectory forum

It now works well with forum permissions, and the vBulletin's scheduled task system. I have personally installed the reviewed vBGSiteMap on a site with over 200,000 urls. Copes with the large number of urls with no problems.

The vBGSiteMap works well with vbSEO, and it lists all the old url's to allow Google to spider the old url's and so find the 301 redirects to the new, and so delete the old url's from its index.

Compared to the previous versions

  • Sitemap files now written into their own directory - means this can be safely chmod 777 - thanks Sarah King
  • config and class files separated out
  • new help file written
  • many corrections made to the code - amazing what sitting on a piece of code can do, and amazing what you can learn from personally installing on many different servers.
  • Can now work on mysql versions from 3.23.58 to 5+
Specifications
  • works with v3.03 - 3.5
  • access to this file is password protected
the same password as the database via the vBulletin includes/config.php file
  • creates an index file and multiple gzipped site maps to less than the maximum permitted by Google (I have in fact restricted it to 3k url's, rather than 50k as my browser takes a while to process the file when checking it)
  • creates a gzipped file containing the urls for Yahoo Sitemap
  • the site map files are created in the /vbgsitemap/files directory which needs to be chmod to 777
adds
  • forums - with paginations of forums (excluding redirects and password protected forums)
  • threads - with pagination of threads (excluding invisible threads=soft deleted, and threads inside password protected forums)
  • archive forum pages with paginations
  • archive versions of threads with paginations
  • members
extra
  • extra urls from other program types
  • add a new url per line onto file.txt, and a gzipped file will be created for it, and added to the site index file.
How to install
  • unzip the files
  • copy the vbgsitemap folder to your root directory
  • chmod the vbgsitemap/files directory to 777
  • copy vbgsitemap.php to your root directory
  • copy the includes/cron/vbgsitemap-cron.php file to your vbulletin includes/cron/ directory
  • look over the configuration options on the /vbgsitemap/vbgsitemap-config.php file
    • $base="" or "forum/" - if your forum is the actual root, or in the forum directory etc.
    • $addthreadarchive=false; - whether you want the archive version of the threads to be added or not.
    • the rest should not need to be changed
    • change to $xtrafile="file.txt"; if you have additional urls that you want included from another package, get a list of those url's and add them to file.txt.
  • Then access the /vbgsitemap/index.php file in your browser to get things happening.
  • The username/password is the username/password of your database.
  • Add the resulting one index file to Google sitemaps: http://www.yourdomain.com/vbgsitemap.php
  • Add the other file to Yahoo sitemaps
    http://www.yourdomain.com/vbgsitemap/files/urllist.gz
  • A cron job can be setup in the vbulletin scheduled tasks

    • ./includes/cron/vbgsitemap-cron.php
    • depending on the number of posts/new threads to your forum, set to run daily or weekly etc. The cron will automatically ping Google and return success/failure into the cron log.

Show Your Support

  • This modification may not be copied, reproduced or published elsewhere without author's permission.

Comments
  #212  
Old 11-11-2005, 08:00 PM
T2DMan T2DMan is offline
 
Join Date: Apr 2004
Location: Auckland, New Zealand
Posts: 81
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

What are the url's of your pages??? What has Google cached? What do you want Google to cache? What do you want shown on the serps. If the url includes strings as part of the url, then that is the url of that page.

In vBulletin standard, all the threads are url strings, and that is what you want cached by Google, therefore in the sitemap. Same for any other page.
Reply With Quote
  #213  
Old 11-11-2005, 08:08 PM
konstance's Avatar
konstance konstance is offline
 
Join Date: Dec 2002
Location: oklahoma
Posts: 40
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

well, that makes sense. thanks!
Reply With Quote
  #214  
Old 11-14-2005, 08:39 PM
Reverend Reverend is offline
 
Join Date: Mar 2002
Location: England
Posts: 206
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

when i run the creator it pings with no errors, however all the links it creates are missing the forums directory.

/vbgsitemap/files/

but it should be

/forums/vbgsitemap/files/
Reply With Quote
  #215  
Old 11-19-2005, 01:49 PM
Citizen Citizen is offline
 
Join Date: Sep 2005
Posts: 129
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

How do I uninstall this hack?
Reply With Quote
  #216  
Old 11-19-2005, 01:52 PM
Moparx Moparx is offline
 
Join Date: Jul 2004
Posts: 120
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by Citizen
How do I uninstall this hack?
you delete the files you uploaded when you installed it
Reply With Quote
  #217  
Old 11-19-2005, 06:45 PM
futuregizmo futuregizmo is offline
 
Join Date: Aug 2005
Posts: 22
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

would this work with DeanC's SEO vb URL Rewrite hack: https://vborg.vbsupport.ru/showthread.php?t=91324 ?
Reply With Quote
  #218  
Old 11-19-2005, 06:51 PM
Moparx Moparx is offline
 
Join Date: Jul 2004
Posts: 120
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by futuregizmo
would this work with DeanC's SEO vb URL Rewrite hack: https://vborg.vbsupport.ru/showthread.php?t=91324 ?
no it wont
it will use VBSEO though
Reply With Quote
  #219  
Old 11-20-2005, 12:38 AM
T2DMan T2DMan is offline
 
Join Date: Apr 2004
Location: Auckland, New Zealand
Posts: 81
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by Reverend
when i run the creator it pings with no errors, however all the links it creates are missing the forums directory.

/vbgsitemap/files/

but it should be

/forums/vbgsitemap/files/
check the config file and make sure that you have your forum directory in there:
$base="forums/"; // "" if in root, $base="forum/"; //if in the subdirectory forum

The vbgsitemap is off the root directory so that not only can you add vbulletin url's, but your other url's. The vbgsitemap.php needs to be in the root, so that Google can add url's off your root as well. vbgsitemap.php accesses the actual files in the /vbgsitemap/files/ directory
Reply With Quote
  #220  
Old 12-16-2005, 07:50 PM
BiReL41r BiReL41r is offline
 
Join Date: Nov 2005
Posts: 94
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

What exactly does this hack do? Help!
Reply With Quote
  #221  
Old 12-16-2005, 08:00 PM
T2DMan T2DMan is offline
 
Join Date: Apr 2004
Location: Auckland, New Zealand
Posts: 81
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Google has got a site map system whereby you tell it the url's of your website, and it is then able to find them easier. You can diret it to look at the url's less often than they would normally (ie if content doesnt change too often) and so save bandwidth, or for google to check more frequently if content is often changing.

It is especially good if you have lots of new threads being created. The sitemap will show the create date of those threads and google should find them faster than otherwise.
Reply With Quote
Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 04:07 PM.


Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.06279 seconds
  • Memory Usage 2,312KB
  • Queries Executed 25 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)ad_showthread_beforeqr
  • (3)bbcode_quote
  • (1)footer
  • (1)forumjump
  • (1)forumrules
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (1)modsystem_post
  • (1)navbar
  • (4)navbar_link
  • (120)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (4)pagenav_pagelink
  • (1)pagenav_pagelinkrel
  • (11)post_thanks_box
  • (11)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (11)post_thanks_postbit_info
  • (10)postbit
  • (11)postbit_onlinestatus
  • (11)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open
  • (1)tagbit_wrapper 

Phrase Groups Available:
  • global
  • inlinemod
  • postbit
  • posting
  • reputationlevel
  • showthread
Included Files:
  • ./showthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showthread_start
  • showthread_getinfo
  • forumjump
  • showthread_post_start
  • showthread_query_postids
  • showthread_query
  • bbcode_fetch_tags
  • bbcode_create
  • showthread_postbit_create
  • postbit_factory
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • fetch_musername
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • pagenav_page
  • pagenav_complete
  • tag_fetchbit_complete
  • forumrules
  • navbits
  • navbits_complete
  • showthread_complete