vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vBulletin 3.7 Add-ons (https://vborg.vbsupport.ru/forumdisplay.php?f=228)
-   -   Administrative and Maintenance Tools - vBSEO Google/Yahoo Sitemap Generator (https://vborg.vbsupport.ru/showthread.php?t=184573)

ATVTorture 02-04-2009 12:15 AM

Makes perfect sense. Thanks for the tip. Re-ran it the way you suggested to get it updated.

I have another question. I noticed in a lot forums that many people submit multiple sitemaps for one domain URL like sitemap_1, sitemap_2, sitemap_3, etc.. What is the purpose of this and are they getting a whole differnet set of URLs?

Thanks!
Buster

iojam 02-04-2009 12:35 AM

You should only submit sitemap_index.xml.gz - it includes links to all your sitemap files (sitemap_X.xml.gz)

ATVTorture 02-04-2009 03:47 AM

Well when I look in that file, all it shows is sitemap_1.xml.gz. So what's the difference? I guess I don't understand the purpose of multiple sitemap files. I also don't see what generates multiple ones since the sitemap generator only creates one by default.

Is there some advantage to multiple ones and if so, what do the differnet ones point to differently than just one?

Thanks for any insight you can provide.

Buster

iojam 02-04-2009 10:23 AM

In case if you have many URLs vBSEO Sitemap Generator will separate them on multiple file (default setting is 20,000 URLs max per file).

nca 02-04-2009 11:27 PM

I keep running the generate link from the control panel and it says that everything ran fine. But when I go through FTP to the site the files it said it created are nowhere to be found.

Here is the output it gives me:

Code:

[homepage] [4,875.7Kb mem used] [0s (+0s)]
[SECTION START] forumdisplay [4,875.8Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 4, total threads: 0, pages: 1 [4,875.9Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 3, total threads: 0, pages: 1 [4,894.5Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 5, total threads: 409, pages: 21 [4,894.8Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 6, total threads: 97, pages: 5 [4,896.9Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 7, total threads: 93, pages: 5 [4,899.5Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 8, total threads: 46, pages: 3 [4,900.9Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 9, total threads: 83, pages: 5 [4,902.1Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 10, total threads: 110, pages: 6 [4,903.3Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 11, total threads: 130, pages: 7 [4,905.0Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 12, total threads: 85, pages: 5 [4,907.1Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 13, total threads: 35, pages: 2 [4,909.1Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 14, total threads: 197, pages: 10 [4,910.8Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 15, total threads: 16, pages: 1 [4,913.9Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 16, total threads: 29, pages: 2 [4,917.2Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 17, total threads: 56, pages: 3 [4,917.9Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 18, total threads: 119, pages: 6 [4,919.0Kb mem used] [0s (+0s)]
[SECTION START] showthread [4,921.1Kb mem used] [0s (+0s)]
[archive homepage] [5,037.5Kb mem used] [3s (+3s)]
[SECTION START] forumdisplay archived [5,038.4Kb mem used] [3s (+0s)]
[SECTION START] member [5,048.7Kb mem used] [3s (+0s)]
[create sitemap file] filename: sitemap_1.xml.gz, number of urls: 25000 [4,905.4Kb mem used] [3s (+1s)]
[create sitemap in text format] part #2 [4,905.3Kb mem used] [3s (+0s)]
[SECTION START] polls [5,115.4Kb mem used] [4s (+1s)]
[SECTION START] blogs [5,134.0Kb mem used] [4s (+0s)]
[SECTION START] albums [5,136.7Kb mem used] [4s (+0s)]
[SECTION START] groups [5,136.8Kb mem used] [4s (+0s)]
[SECTION START] tags [5,137.4Kb mem used] [4s (+0s)]
[create sitemap file] filename: sitemap_2.xml.gz, number of urls: 2410 [4,909.0Kb mem used] [4s (+0s)]
[create sitemap in text format] part #3 [4,908.9Kb mem used] [4s (+0s)]
[create sitemap index] filename: sitemap_index.xml.gz, number of sitemaps: 2 [4,909.3Kb mem used] [4s (+0s)]
Sitemap has been created. Click here to return [4,905.6Kb mem used] [4s (+0s)]



But again when I go looking for the sitemaps it said it created I cannot locate them. A click on the link to view the google and yahoo ones just gives a 404 error.



Here is my .htaccess file:

Code:

# Comment the following line (add '#' at the beginning)

# to disable mod_rewrite functions.

# Please note: you still need to disable the hack in

# the vBSEO control panel to stop url rewrites.

RewriteEngine On



# Some servers require the Rewritebase directive to be

# enabled (remove '#' at the beginning to activate)

# Please note: when enabled, you must include the path

# to your root vB folder (i.e. RewriteBase /forums/)

#RewriteBase /



#RewriteCond %{HTTP_HOST} !^www\.yourdomain\.com

#RewriteRule (.*) http://www.yourdomain.com/forums/$1 [L,R=301]



RewriteRule ^((urllist|sitemap).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]



RewriteCond %{REQUEST_URI} !(admincp/|modcp/|cron)

RewriteRule ^((archive/)?(.*\.php(/.*)?)?)$ vbseo.php [L,QSA]



RewriteCond %{REQUEST_FILENAME} !-f

RewriteCond %{REQUEST_FILENAME} !-d

RewriteCond %{REQUEST_FILENAME} !^(admincp|modcp|clientscript|cpstyles|images)/

RewriteRule ^(.+)$ vbseo.php [L,QSA]


iojam 02-04-2009 11:47 PM

What exactly is your sitemap URL?
Try to change this line:
RewriteCond %{REQUEST_URI} !(admincp/|modcp/|cron)
to:
RewriteCond %{REQUEST_URI} !(admincp/|modcp/|cron|vbseo_sitemap/)

nca 02-05-2009 12:11 AM

It worked! :) thank you iojam!!

Now when I visit the forum in firefox there are no google adsense ads anywhere to be found. Would this sitemap generator affect the ads in the pages?

here the the forum:
http://forum.horseville.com

the is the page for example:
http://forum.horseville.com/intros/1...ggestions.html
When viewed with IE it shows the ads, when viewed with firefox no ads are to be found.

dholt 02-07-2009 02:32 AM

will this work with 3.8.0

buro9 02-09-2009 04:41 AM

Quote:

Originally Posted by chadi (Post 1729618)
I manually ran the task and got this:

Code:

Database error in vBulletin 3.8.1:

Invalid SQL:

                SELECT count(*)as cnt,max(dateline) as lastupdate
                FROM groupmessage
                WHERE groupid='1';

MySQL Error  : Unknown column 'groupid' in 'where clause'
Error Number  : 1054
Request Date  : Friday, January 30th 2009 @ 09:45:06 PM
Error Date    : Friday, January 30th 2009 @ 09:45:09 PM
Script        : http://www.talkjesus.com/xxxxx/cronadmin.php?do=runcron&cronid=56
Referrer      : http://www.talkjesus.com/xxxxx/cronadmin.php?do=modify
IP Address    : xxxxx
Username      : Chad
Classname    : vB_Database
MySQL Version : 5.0.67-community


Quote:

Originally Posted by iojam (Post 1729772)

Solved my problem too... good work.

steven.hartland 02-09-2009 07:50 PM

First off the fix for vb 3.8.2 as the group changes break the base code:-
Code:

--- vbseo_sitemap_functions.php.orig    2009-02-06 14:57:36.000000000 +0000
+++ vbseo_sitemap_functions.php 2009-02-06 14:59:58.000000000 +0000
@@ -569,6 +569,7 @@
                $tcount = $db->query_first("
                        SELECT count(*)as cnt,max(dateline) as lastupdate
-                      FROM " . TABLE_PREFIX . "groupmessage
-                      WHERE groupid='$rrow[groupid]'
+                      FROM " . TABLE_PREFIX . "discussion d, " . TABLE_PREFIX . "groupmessage g
+                      WHERE d.groupid='$rrow[groupid]'
+                              AND g.discussionid = d.discussionid
                ");
                $pcount = ceil($tcount['cnt']/$vboptions['vm_perpage']);

Next up we are getting a load of garbage in our sitemap even the zcat cant read the files:-
Code:

sh -c ' for i in *.gz; do echo $i; zcat $i | head; done' > 1
zcat: sitemap_21.xml.gz: trailing garbage ignored
zcat: sitemap_24.xml.gz: trailing garbage ignored
zcat: sitemap_27.xml.gz: trailing garbage ignored
zcat: sitemap_30.xml.gz: trailing garbage ignored
zcat: data stream error
zcat: sitemap_31.xml.gz: uncompress failed
zcat: data stream error
zcat: sitemap_34.xml.gz: uncompress failed
zcat: sitemap_36.xml.gz: trailing garbage ignored
zcat: data stream error
zcat: sitemap_37.xml.gz: uncompress failed
zcat: data stream error
zcat: sitemap_39.xml.gz: uncompress failed
zcat: sitemap_42.xml.gz: trailing garbage ignored
zcat: urllist.txt.gz: not in gzip format

Even some of the files that can be decompress are corrupt internally with invalid xml e.g. the data of the lastmod appearing in the url and missing close tags all over.

Has anyone seen this sort of corruption before?

We are running the following:-
Code:

PHP 5.2.6 with Suhosin-Patch 0.9.6.2 (cli) (built: Sep 18 2008 16:29:55)
Copyright (c) 1997-2008 The PHP Group
Zend Engine v2.2.0, Copyright (c) 1998-2008 Zend Technologies
    with Zend Extension Manager v1.2.2, Copyright (c) 2003-2007, by Zend Technologies
    with Zend Optimizer v3.3.0, Copyright (c) 1998-2007, by Zend Technologies

apache-2.2.8        Version 2.2 of Apache web server with prefork MPM.

FreeBSD loncore1.multiplay.co.uk 7.0-RELEASE-p2 FreeBSD 7.0-RELEASE-p2 #9: Mon Jun 30 17:43:02 BST 2008



All times are GMT. The time now is 08:01 AM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.02000 seconds
  • Memory Usage 1,767KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (6)bbcode_code_printable
  • (2)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (4)pagenav_pagelink
  • (3)pagenav_pagelinkrel
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (10)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete