vBSEO Google/Yahoo Sitemap Generator for vBulletin 3.6.x, 3.5.x & 3.0.x

[vBSEO]

vBSEO Google/Yahoo Sitemap Generator - vBulletin 3.5.x
Download vB 3.8.x Compatible Version Here (https://vborg.vbsupport.ru/showthread.php?t=206169)
Download vB 3.7.x Compatible Version Here (https://vborg.vbsupport.ru/showthread.php?t=184573)
Download vB 3.6.x Compatible Version Here (https://vborg.vbsupport.ru/showthread.php?t=144730)
Download vB 3.0.x Compatible Version Here (https://vborg.vbsupport.ru/showthread.php?t=144732)


Note: Version 2.5 replaces all previous versions of the vBSEO Google/Yahoo Sitemap Generator, and now includes support for all the new URL types in vBulletin 3.8.x.

Overview
============================

Providing Google, Yahoo, Ask sitemaps is an essential step towards improving your forums.

The "vBSEO Google Sitemaps" plugin provides a solution that allows your forum to be indexed by the Google (http://www.google.com/) (and also Yahoo (http://www.yahoo.com/) and Ask (http://www.ask.com/)) search engines faster, more completely, more effectively, and with less bandwidth consumption.

The ultimate goal is to help you achieve more web traffic for your forum.

https://services.google.com/inquiry/publishertools?hl=en_US (https://services.google.com/inquiry/publishertools?hl=en_US)
Google Sitemaps is an easy way for you to help improve your site?s representation in the Google index. It's a collaborative crawling system that enables you to communicate directly with Google. You get a smarter crawl because you can provide Google with specific information about all your web pages, such as when a page was last modified or how frequently it changes.


Note: This plugin is fully compliant with vBSEO 3.x version. The current version is vBSEO 3.2 (http://www.vbseo.com/f5/vbseo-3-2-0-gold-released-24675/). However, if you are running vBSEO, please upgrade to vBSEO 3.2 or greater before installing.

Compatibility
============================

Fully compatible with:
vBulletin 3.0.x, 3.5.x, 3.6.x, 3.7.x and 3.8.x
vBulletin Blogs 1.0.x and 2.0.x *Optional
vBSEO 2.x, 3.x *OptionalWhat does it do?

============================
Auto-generates a Google XML sitemap for all of your specified forum URL types (including vBulletin Blog URLs).
Auto-generates a Yahoo text sitemap for all of your specified forum URL types.
Auto-notifies Google when a new sitemap is generated.
Automatically sends you a summary of the sitemap generation via email each time it is created.
Includes only publicly accessible forums and threads.
Allows Google/Yahoo to find all of your forum URLs without having to spider the forum to find the links.
Allows Google/Yahoo to find your forum URLs without having to account for query string and/or session ID information.
Allows Google to give precedence to crawling your higher priority forum pages.
Allows Google to give precedence to crawling your forum pages that change more frequently.
Allows you to conserve bandwidth by more efficiently facilitating the crawling processes for GoogleBot and Yahoo Slurp.
Is 100% compatible with the static CRUs (Content Relevant URLs) used by vBSEO (http://www.vbseo.com/)-enabled forums.How does it work?
============================

Whenever it is scheduled or invoked via the URL, this plugin will generate both the Google XML formatted and the Yahoo text formatted sitemaps. If you selected "Yes" to the Google auto-notification setting, Google will be notified each time the sitemap is generated. The Yahoo sitemap must be manually submitted to http://submit.search.yahoo.com/free/request/ (http://submit.search.yahoo.com/free/request/).
Google Sitemap files are gzipped
Forum and thread pages are listed with pagination (i.e. all pages for each forums/thread are included in the sitemap)
Maximum Priority is set for Sticky threads.
Optimization for sitemap generation on large forums.Automated Reporting Tool
============================

The vBSEO Sitemap includes a report tool, allowing you to track your progress. To access your reports enter the following URL:

http://www.example.com/forums/vbseo_sitemap/ (http://www.example.com/forums/vbseo_sitemap/)

NOTE: Replace "http://www.example.com/forums/ (http://www.example.com/forums/)" with the full URL to your vB forum root.


You will be required to login by providing your "Sitemap Interface Access Password" from your vBSEO Sitemap settings in:
vBulletin Admin CP (for 3.5.x/3.6.x/3.7.x/3.8.x users) OR
vbseo_sitemap.php configuration file (for 3.0.x users) located in the vbseo_sitemap directory in your forum root.Once you successfully login, you will be provided with a list of 'Useful Links'. Here are the 4 main links:

Show Reports List
The 'Show Reports List' link will display a report of each time your vBSEO Sitemap generator executed, including the (1) date, (2) run time, (3) total URLs included, and (4) and change in # of URLs included from the last generation.

Each vBSEO Sitemap generation record will include a (1) "View details" and (2) "Remove record" link. The "View Details" link shows more detailed information about the sitemap generated. The "Remove record" will permanently delete the record from your reports.

Show Sitemap Downloads Log
The 'Show Sitemap Downloads Log' link will display a report of each time your vBSEO Sitemap was downloaded by either a search engine (GoogleBot or Yahoo) or by another user agent (i.e. Web browser, etc.).

The report includes the (1) date, (2) name of sitemap file downloaded, (3) Bot, (4) IP address of the downloader, and the (5) User-agent.

Each vBSEO Sitemap download record will include a "Remove record" link which will permanently delete the record from your reports.

Run Sitemap Generator
The 'Run Sitemap Generator' link will automatically regenerate your Google and Yahoo sitemaps.

Your Forums Homepage
The 'Your Forums Homepage' link is a quick link back to your forum homepage.

Additional Links
Additional links to various other related SEO resources are also included.


Click "Install"
============================

Please click "Install" to show your support for this script. :)


Installation & Configuration for vB 3.5.x, 3.6.x, 3.7.x and 3.8.x as a Plugin
============================

Follow the installation/upgrade instructions provided in the docs/readme.html file.


Google Webmaster Accounts
============================

It is NOT required for you to have a Google Webmaster account to run the vBulletin Google Sitemaps plugin. If you decide to setup an account for testing purposes you can do so here:
http://www.google.com/webmasters/sitemaps/login?sourceid=gsm&subid=us-et-about2 (http://www.google.com/webmasters/sitemaps/login?sourceid=gsm&subid=us-et-about2)


Copyright & Licensing

============================
vBSEO Google Sitemaps plugin is copyright protected by Crawlability Inc.
You are free to download and install this plugin on any vBulletin forum for which you hold a valid vB license.
Unauthorized distribution of any code and/or documentation, whole or in part, included here is strictly prohibited.
In addition, the following copyright notice must be maintained.vBSEO(TM) ? 2005-2009 Crawlability, Inc.


Revision History
============================

02/22/2009 - Version 2.5 Released

NEW FEATURE: Blog tags URLs are included.
NEW FEATURE: Social Group Discussion URLs are included.
NEW FEATURE: Smart Priority applied for the following URL types
Show Post
Member Profiles
Forum Display
Poll Results
Blog Entries
Member Profile Albums
Social Groups
Social Groups Discussions
Social Group Pictures
Tags
Blog TagsUPDATE: Compatible with vBulletin 3.8.x. Includes the following updated settings:
Priority Range - Show Post
Priority Range - Member Profiles
Priority Range - Forum Display
Priority Range - Poll Results
Priority Range - Show Thread
Priority Range - Blog Entries
Priority Range - Member Profile Albums
Priority Range - Social Groups
Priority Range - Social Group Pictures
Priority Range - Tags Fix: Social Group Discussion database error is fixed.

Upgrade Instructions
============================

(1) Follow the installation/upgrade instructions provided in the docs/readme.html file.

(2) For versions of vBulletin 3.6.x only: Open "Schedule Manager" in the vBulletin Admin Control Panel (admincp); Remove existing scheduled task for Sitemap Generator if you have one.
Note: The new task will be automatically setup when you import the XML product file.

Other vBSEO Plugins

============================
vBSEO - vBulletin Search Engine Optimization
(http://www.vbseo.com/)
vBSEO Conditional Signatures for vBulletin (https://vborg.vbsupport.ru/showthread.php?t=97685)vBSEO Affiliate Program
============================

We welcome you to join the vBSEO Affiliate Program (http://www.vbseo.com/aff/).

[vBSEO]

Note: This plugin/mod has been tested and is ready for full release. Therefore, we are not listing it as "Is in Beta stage".

For those of you who discover potential bugs, please report them here and we will investigate the issue immediately.

For those of you interested in developing your own vB plugins, please check out the API Documentation for 3.5.x recently announced:

http://members.vbulletin.com/api/

[Acers]

grt grt:P
had been doing manually

grt work

[Brandon Sheley]

will this work without buying the vbseo mod ? for 150$ or whatever it cost ??

[CompuJonathan]

Warning: main(global.php): failed to open stream: No such file or directory in /forum/vbseo_sitemap/vbseo_sitemap.php on line 33

Warning: main(global.php): failed to open stream: No such file or directory in /forum/vbseo_sitemap/vbseo_sitemap.php on line 33

Warning: main(): Failed opening 'global.php' for inclusion (include_path='.:/usr/lib/php:/usr/local/lib/php') in /forum/vbseo_sitemap/vbseo_sitemap.php on line 33

Warning: main(./includes/functions_cron.php): failed to open stream: No such file or directory in /forum/vbseo_sitemap/vbseo_sitemap.php on line 36

Fatal error: main(): Failed opening required './includes/functions_cron.php' (include_path='.:/usr/lib/php:/usr/local/lib/php') in /home/chatsusa/public_html/forum/vbseo_sitemap/vbseo_sitemap.php on line 36
Any clue what I did wrong?

[iojam]

CompuJonathan,

how do you execute it:
- using URL
- from vB scheduler
- from shell command line
?

[CompuJonathan]

CompuJonathan,

how do you execute it:
- using URL
- from vB scheduler
- from shell command line
?

vB scheduler

When I run it from this URL: http://www.xxxxx.com/forum/vbseo_sitemap/index.php

I get the following error:

Warning: main(DIR/includes/functions_forumlist.php): failed to open stream: No such file or directory in /vbseo_sitemap/vbseo_sitemap.php on line 48

Fatal error: main(): Failed opening required 'DIR/includes/functions_forumlist.php' (include_path='.:/usr/lib/php:/usr/local/lib/php') in /home/yoursite/public_html/forum/vbseo_sitemap/vbseo_sitemap.php on line 48

Thanks!
- Compu

[jward]

will this work without buying the vbseo mod ?
vBSEO is not required.

[iojam]

vB scheduler
What is your vB version?

[Unexplained.tv]

Just clicked install and will be installing this, along with the latest vBSEO either tonight or tomorrow when I have the time (it's 12:15 am here)

[CompuJonathan]

What is your vB version?

3.0.7

[Brandon Sheley]

vBSEO is not required.

okay thx, i may check this out tomarrow, after i get some sleep :p thx for releasing it

[jward]

@Loco Macheen:

Ok, let me know how it goes. :)

@Unexplained:

No, this is compatible with both vB 3.0.x and 3.5.x.

[CompuJonathan]

--- Update ---

Here are the errors I get from running in the Admin CP scheduler:

vBSEO - Create Google/Yahoo Sitemap


Warning: main(global.php): failed to open stream: No such file or directory in /forum/vbseo_sitemap/vbseo_sitemap.php on line 33

Warning: main(global.php): failed to open stream: No such file or directory in /forum/vbseo_sitemap/vbseo_sitemap.php on line 33

Warning: main(): Failed opening 'global.php' for inclusion (include_path='.:/usr/lib/php:/usr/local/lib/php') in /forum/vbseo_sitemap/vbseo_sitemap.php on line 33

Warning: main(./includes/functions_cron.php): failed to open stream: No such file or directory in /forum/vbseo_sitemap/vbseo_sitemap.php on line 36

Fatal error: main(): Failed opening required './includes/functions_cron.php' (include_path='.:/usr/lib/php:/usr/local/lib/php') in /home/yoursite/public_html/forum/vbseo_sitemap/vbseo_sitemap.php on line 36

Here are the errors I get from running from the vbseo URL:

Warning: main(DIR/includes/functions_forumlist.php): failed to open stream: No such file or directory in /vbseo_sitemap/vbseo_sitemap.php on line 48

Fatal error: main(): Failed opening required 'DIR/includes/functions_forumlist.php' (include_path='.:/usr/lib/php:/usr/local/lib/php') in /home/chatsusa/public_html/forum/vbseo_sitemap/vbseo_sitemap.php on line 48

[iojam]

CompuJonathan,

thanks for reporting.
We found the problem with vB3.0.x compatibility. We will post an update shortly.

[CompuJonathan]

CompuJonathan,

thanks for reporting.
We found the problem with vB3.0.x compatibility. We will post an update shortly.

Your welcome! I'm great for beta testing. ;)

- Compu

[vBSEO]

@CompuJonathan

I've updated the .zip file. Please try again ;)

[CompuJonathan]

@CompuJonathan

I've updated the .zip file. Please try again ;)

Ty Sir! Perfect! :banana:

[CompuJonathan]

Oops! I spoke too soon.

I'm not sure if this matters or not, but when I view a generated sitemap details under the sitemap files, the link is incorrect.

It as showing as: http://www.xxxx.com/forum/sitemap.txt when it should be http://www.xxx.com/forum/vbseo_sitemap/data/sitemap.txt ?

Also, what is the URL that I should submit to google and yahoo?

[vBSEO]

Ty Sir! Perfect! :banana:

Great!

Oops! I spoke too soon.

Edit: not so great :classic:

[iojam]

CompuJonathan,

Oops! I spoke too soon.
two mod_rewrite lines should be added to your "vbroot/.htaccess" file as described in installation instructions.

Google requires that sitemap file reside at the same level or higher in your website directory structure. That's why you should use http://www.xxxx.com/forum/sitemap.txt (xml.gz) type of sitemap URL.

[CompuJonathan]

CompuJonathan,


two mod_rewrite lines should be added to your "vbroot/.htaccess" file as described in installation instructions.

Google requires that sitemap file reside at the same level or higher in your website directory structure. That's why you should use http://www.xxxx.com/forum/sitemap.txt (xml.gz) type of sitemap URL.

This is what I have:

RewriteEngine On
RewriteRule ^(sitemap.*\.(xml\.gz|txt))$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]

---Edit---
I tried both of the codes you have. The 1 in the first post and the 1 in the install file are different, but neither of them seem to work. I just get 404's.

[vBSEO]

Do you have the rules in root? they must be in *vbroot* (http://www.xxxx.com/forum/.htaccess)

[CompuJonathan]

Do you have the rules in root? they must be in *vbroot* (http://www.xxxx.com/forum/.htaccess)

Ha! Brilliant!

Sorry about that, I had it located in my public_html directory. :o

[reteep]

Very nice hack but unfortunately it doesn't seem to be PHP5 compatible:


Warnung: array_merge() [function.array-merge]: Argument #2 is not an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 122)

Warnung: array_merge() [function.array-merge]: Argument #2 is not an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 122)

Warnung: array_merge() [function.array-merge]: Argument #2 is not an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 122)

Warnung: array_merge() [function.array-merge]: Argument #2 is not an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 122)

Warnung: array_merge() [function.array-merge]: Argument #2 is not an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 122)

Warnung: array_merge() [function.array-merge]: Argument #2 is not an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 122)

Warnung: array_merge() [function.array-merge]: Argument #2 is not an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 122)

Warnung: array_merge() [function.array-merge]: Argument #2 is not an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 122)

Warnung: array_unique() [function.array-unique]: The argument should be an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 126)

Warnung: array_merge() [function.array-merge]: Argument #2 is not an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 122)

Warnung: array_merge() [function.array-merge]: Argument #2 is not an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 122)

Warnung: array_merge() [function.array-merge]: Argument #2 is not an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 122)

Warnung: array_merge() [function.array-merge]: Argument #2 is not an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 122)

Warnung: array_unique() [function.array-unique]: The argument should be an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 126)

Warnung: array_merge() [function.array-merge]: Argument #2 is not an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 122)

Warnung: array_unique() [function.array-unique]: The argument should be an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 126)

Warnung: array_merge() [function.array-merge]: Argument #2 is not an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 122)

Warnung: array_merge() [function.array-merge]: Argument #2 is not an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 122)

Warnung: array_merge() [function.array-merge]: Argument #2 is not an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 122)

Warnung: array_merge() [function.array-merge]: Argument #2 is not an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 122)

Warnung: array_merge() [function.array-merge]: Argument #2 is not an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 122)

Warnung: array_unique() [function.array-unique]: The argument should be an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 126)

Warnung: array_merge() [function.array-merge]: Argument #2 is not an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 122)

Warnung: array_unique() [function.array-unique]: The argument should be an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 126)

Warnung: array_merge() [function.array-merge]: Argument #2 is not an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 122)

Warnung: array_merge() [function.array-merge]: Argument #2 is not an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 122)

Warnung: array_merge() [function.array-merge]: Argument #2 is not an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 122)

Warnung: array_merge() [function.array-merge]: Argument #2 is not an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 122)

Warnung: array_unique() [function.array-unique]: The argument should be an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 126)

Warnung: array_merge() [function.array-merge]: Argument #2 is not an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 122)

(continued, didn't want to post all of it)

arnung: array_unique() [function.array-unique]: The argument should be an array in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 126)
[homepage] [0s (+0)]
[SECTION START] forumdisplay [0s (+0)]

Warnung: Invalid argument supplied for foreach() in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 155)
[SECTION START] showthread [0s (+0)]

Warnung: Invalid argument supplied for foreach() in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 202)
[archive homepage] [0s (+0)]
[SECTION START] forumdisplay archived [0s (+0)]

Warnung: Invalid argument supplied for foreach() in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 155)
[SECTION START] showthread archived [0s (+0)]

Warnung: Invalid argument supplied for foreach() in /vbseo_sitemap/vbseo_sitemap_functions.php (Zeile 202)
[SECTION START] member [0s (+0)]
[create sitemap file] filename: sitemap_1.xml.gz, number of urls: 25344 [2s (+2)]
[create sitemap in text format] part #1 [2s (+0)]
[create sitemap index] filename: sitemap_index.xml.gz, number of sitemaps: 1 [2s (+0)]

[kall]

Amazingly scary typo in the install instructions Juan!

Upload ALL the files & folders in the 'vbseo_sitemap' folder to your forum root
The foolish or reckless among us may actually follow that instruction, overwriting their own index.php with this one.

Surely it should read: "Upload the 'vbseo_sitemap' folder to your forum root"

[michaelbenson]

Excellent addition guys, will surely be worth it. What about the T2DMAN version? Which performs ideally the same function, should that be uninstalled and that installed over?

[TundraSoul]

I tried to submit my sitemap.txt twice to Yahoo, but their server timed out.

[john_robot]

Excuse me, I have no Idea what links to submit. Is it ok to submit http://www.hotwebhostingtalk.com/sitemap_index.xml.gz and http://www.hotwebhostingtalk.com/sitemap_1.xml.gz ? What about yahoo? Do I have to submit http://www.hotwebhostingtalk.com/sitemap.txt ( Direct URL) ?

[BamaStangGuy]

This is not working at all for me.

The cron job runs but nothing happens. I get no email nothing.

I tried the manual link and it acts like it is doing something and then all I get is a white blank page.

Show Reports List shows nothing at all :(

Anyone else experiencing this????

[rike-online]

Hi,

yes, same problem here...

I saw the changes in google with typing "site:XXXXXXXX.com", all URLs are changed from old to new content... but there is no notifikation or report... and no txt-file for uploading to yahoo...

greetings
rike

[rike-online]

In case of running the script manually, I get this error:

Fatal error: Allowed memory size of 26214400 bytes exhausted (tried to allocate 9585341 bytes) in /www/htdocs/v12345/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 408

MySQL: 4.0.25
PHP: 4.4.1
Apache: 1.3.33

Any hints?

[iojam]

TundraSoul
I tried to submit my sitemap.txt twice to Yahoo, but their server timed out.
I've seen the same problem with sitemap submission service at Yahoo, but worked after serveral retries.

john_robot
Excuse me, I have no Idea what links to submit. Is it ok to submit http://www.hotwebhostingtalk.com/sitemap_index.xml.gz and http://www.hotwebhostingtalk.com/sitemap_1.xml.gz ? What about yahoo? Do I have to submit http://www.hotwebhostingtalk.com/sitemap.txt ( Direct URL) ?

Google sitemap is submitted automatically by the vBSEO Sitemap Generator (make sure the "Notify Google" option is enabled).

You should submit http://www.hotwebhostingtalk.com/sitemap.txt URL to Yahoo.


BrentWilson
PM sent.

[iojam]

rike-online
In case of running the script manually, I get this error:
Try to reduce a number of URL per sitemap file in Sitemap Generator options at admincp (default is 50K).

[Macindy]

rike-online

Try to reduce a number of URL per sitemap file in Sitemap Generator options at admincp (default is 50K).

Should I activated index posts?

[rike-online]

rike-online

Try to reduce a number of URL per sitemap file in Sitemap Generator options at admincp (default is 50K).

Thanks for your help...

I had to reduce the value from 50000 to 20000, now everything runs perfectly!

Greetings
rike

[Snake]

EXCELLENT HACK! Thanks. :D

[MentaL]

i got vbseo installed and when trying to go to vbseo_sitemap it redirects me to the homepage...

[nitro]

Is this the vbSEO lite edition that was coming soon or is it a different product ?

[Disi]

Hi, i've installed the hack and the files are generates successfully, i'e got vBSEO installed too.

But unfortunatly it won't accesp the direct file so i guess the rewriterule wont work correctly

i've added:

RewriteRule ^(sitemap.*\.(xml\.gz|txt))$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]

the the .htaccess file that comes with vbseo

/edit

it redirects me all the time to the forums page

http://www.bytetales.info/forums/sitemap_index.xml.gz

[dastar]

I have the same problem. It says it generates the xml file but then redirects me to my forum home page when I try going to the url. When I turn off the vbseo redirect to home page it says "Page not found".

EDIT: I figured it out. The files are located at: forums/vbseo_sitemap/data/

[Cedric_FP]

Excuse me, I have no Idea what links to submit. Is it ok to submit http://www.hotwebhostingtalk.com/sitemap_index.xml.gz and http://www.hotwebhostingtalk.com/sitemap_1.xml.gz ? What about yahoo? Do I have to submit http://www.hotwebhostingtalk.com/sitemap.txt ( Direct URL) ?


I am also wondering, would submitting the index.xml to google be a good thing to do or not? I mean, adding it in our google sitemaps user interface.

[TheComputerGuy]

Does this require Ion Cube to be installed?

[MrNase]

Very nice hack but unfortunately it doesn't seem to be PHP5 compatible:


Same errors here, running PHP 5.0.4 :(


So, here's the information from the logfile:

Date 2005-11-09 15:06
Processing time 3.26 s
Total URLs 981 (-)
Forumdisplay URLs 0 (-)
Showthread URLs 0 (-)
ShowPost URLs 0 (-)
Archive URLs 1 (-)
Member Profile URLs 979 (-)

[ConqSoft]

I see that it has a list of forumids to exclude. I assume that it also looks at permissions and will automatically not include any forums that aren't open for viewing by Unregistered/Not Logged In users?

Thanks!

[ConqSoft]

Actually, after looking at the sitemap file that was generated, it does include threads from forums that have permissions set. :(

Any way to add this so that we don't have to worry about keeping the excluded list of forumids up to date?

If the thread/forum isn't visible to guests, then there's really no reason to include it in the sitemap.

[MrNase]

Well at least it works for you ;)

I had a look at the code and couldn't find a reason for the errors I keep getting :(

[ConqSoft]

Also, I found that Google won't accept your sitemap if you have this vbSEO option set to Redirect To Home Page. You have to make it send a 404 error code.

"File Not Found" requests handling?

[quachvu]

i have these errors
vBSEO - Create Google/Yahoo Sitemap


Warning: Call-time pass-by-reference has been deprecated - argument passed by value; If you would like to pass it by reference, modify the declaration of [runtime function name](). If you would like to enable call-time pass-by-reference, you can set allow_call_time_pass_reference to true in your INI file. However, future versions may not support this any longer. in /home/vietpcb6/www.vietphim.com/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 410

Warning: Call-time pass-by-reference has been deprecated - argument passed by value; If you would like to pass it by reference, modify the declaration of [runtime function name](). If you would like to enable call-time pass-by-reference, you can set allow_call_time_pass_reference to true in your INI file. However, future versions may not support this any longer. in /home/vietpcb6/www.vietphim.com/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 435

Warning: Call-time pass-by-reference has been deprecated - argument passed by value; If you would like to pass it by reference, modify the declaration of [runtime function name](). If you would like to enable call-time pass-by-reference, you can set allow_call_time_pass_reference to true in your INI file. However, future versions may not support this any longer. in /home/vietpcb6/www.vietphim.com/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 470
Cannot run sitemap generator directly: you should set "Run from vB Scheduled Tasks Manager ONLY" to "No" in admincp to allow this.

[Cedric_FP]

I got errors, but then realised i hadn't chmodded the database.

Anyhow, excellent hack!

[michaelbenson]

Excellent addition, installed perfectly fine. Should i be using the generated sitemap file for inclusion in other search engines such as MSN too?

[Cedric_FP]

I was unaware MSN allowed sitemaps...

[msimonds]

I cannot get the sitemap to generate. I keep trying to generate one, but i keep getting this note:

Cannot run sitemap generator directly: you should set "Run from vB Scheduled Tasks Manager ONLY" to "No" in admincp to allow this.

I changed the line here

// Run from vB Scheduled Tasks Manager ONLY
'vbseo_sm_crononly' => '2', to 2, since the default was 1, which i assumed it to be yes


also maybe I am just stupid but it seems like you did not close out you ending php tag two files


vbseo_sm_config30x.php
&
vbseo_getsitemap.php

your missing the end tag

Help me out here?

[MrNase]

1 is 'yes', 0 is 'no' :)

Or just change the configuration with the AdminCP :)

[noppid]

I'm still playing while converting this to work with xenon's archive and noticed that VBSEO_ARCHIVE_ROOT is not defined.

Nice tool, appreciate the work.

[msimonds]

thanks man, my bad1 is 'yes', 0 is 'no' :)

Or just change the configuration with the AdminCP :)

[Cedric_FP]

I wonder if anybody can confirm if this increaes listings in google?

[msimonds]

okay my dumb.... i got it to work

have one question:

I can view my sitemap.txt file

I am getting errors on the others

The XML page cannot be displayed




Cannot view XML input using style sheet. Please correct the error and then click the Refresh (javascript:location.reload()) button, or try again later.

An invalid character was found in text content. Error processing resource 'http://www.sportsrant.com/forums/sitemap_index.x...







am i doing something wrong

[ConqSoft]

You don't need to view them. Just log into Google's Sitemaps site:
http://www.google.com/webmasters/sitemaps/login?sourceid=gsm&subid=us-et-about2

And point it to your gzipped sitemap file.

[Cedric_FP]

You have to point google to the sitemap_index.xml.gz file, because more sitemap files may be made depending on the amount of allowerd URL's you set in adminCP

[Cedric_FP]

okay my dumb.... i got it to work

have one question:

I can view my sitemap.txt file

I am getting errors on the others

The XML page cannot be displayed






am i doing something wrong

I am also getting this error. It only hapopens when using the rewrite, if i access it directly via vbseo_sitemap/data/sitemap1.xml.gz, it works fine.

Any update on this error?

[ConqSoft]

Any issues since this stuff is open to anyone?

Example: http://www.vbseo.com/vbseo_sitemap/

[Cedric_FP]

Well, as it turns out, folks at vbseo are also having problems with the URL rewrite and the sitemap_1.xml.gz

It probably means google can't get the sitemap either?

[ConqSoft]

Not sure. I added a direct link to the sitemap_1.xml.gz into my Google Sitemap account. Waiting for it to pick it up now.

[D|ver]

is it possible to also set the priority and the frequency for those extra pages in extra-urls.txt ?

[Cedric_FP]

Not sure. I added a direct link to the sitemap_1.xml.gz into my Google Sitemap account. Waiting for it to pick it up now.

You won't be able to because google requires that the sitemap file be in the root directory of the url you are adding.

Ie.

www.yoursite.com/forums/sitemap.xml.gz

not

www.yoursite.com/forums/blah/blah/sitemap.xml.gz

[ConqSoft]

It accepted it, and verified it just fine....

Edit: And it shows that it was downloaded and status is OK. :up:

[ConqSoft]

Any issues since this stuff is open to anyone?

Example: http://www.vbseo.com/vbseo_sitemap/

Nevermind, they added a password to theirs now. And I found where to add it to mine. :D

[Cedric_FP]

Yeah, in the admin CP.

[jward]

@stormblast, MrNase:

Very nice hack but unfortunately it doesn't seem to be PHP5 compatible:
We are investigating the apparently PHP5 incompatibility you noted.

@kall:

Amazingly scary typo in the install instructions Juan!
Thank-you for catching the error in the install instructions. It has been updated.

@michaelbenson:

Excellent addition guys, will surely be worth it. What about the T2DMAN version? Which performs ideally the same function, should that be uninstalled and that installed over?
Once we correct the initial bugs that have been reported here, we recommend that you update to our sitemap. We are better equipped to provide user support and upgrades on a full time basis.

@Macindy:

Should I activated index posts?
You can include show posts. If you are getting a memory error, try reducing your 'Max URLs in Sitemap Files' setting from its default of 50,000 to 20,000.

@Aftermath:

EXCELLENT HACK! Thanks.
Thank-you for the support. :rolleyes:

@nitro:

Is this the vbSEO lite edition that was coming soon or is it a different product ?
No - this is not vBSEO Lite. This is our Google/Yahoo Sitemap Generator. It is compatible with non-vBSEO enabled forums as well as those running vBSEO 2.2.0 Full and vBSEO Lite (once released).

@mentalrz, Disi, dastar, Cedric_FP:

We are looking into the problem with the sitemap URLs.

@TheComputerGuy:

Does this require Ion Cube to be installed?
No - this is visible source code.

@ConqSoft:

I see that it has a list of forumids to exclude. I assume that it also looks at permissions and will automatically not include any forums that aren't open for viewing by Unregistered/Not Logged In users?
We will look into the problem you noted with threads included for non-guest access forums, as well as the 'Redirect To Home Page' vBSEO config option.

@quachvu:

What version of PHP are you running?

@msimonds:

// Run from vB Scheduled Tasks Manager ONLY

'vbseo_sm_crononly' => '0',

As MrNase noted, the value should be set to 0.

@msimonds,ConqSoft:

You don't need to view them. Just log into Google's Sitemaps site: http://www.google.com/webmasters/si...id=us-et-about2 (http://www.google.com/webmasters/si...id=us-et-about2)

And point it to your gzipped sitemap file.
We submit the sitemap files to Google automatically upon generation if you have the 'Auto-Notify Google' set to 'Yes'.

@ConqSoft:

Any issues since this stuff is open to anyone?

Example: http://www.vbseo.com/vbseo_sitemap/ (http://www.vbseo.com/vbseo_sitemap/)
Yes - make sure you set your 'Direct Script Run Code' to a character string to use as a password when accessing your sitemap reports. We uploaded the latest version and had not yet set our run code.

[msimonds]

what do we do if we try and verify this via google and get this error

We've detected that your 404 (file not found) error page returns a status of 200 (OK) in the header.

how can i correct that

[noppid]

You have a redirect to a good page. That's a no no I believe.

[jward]

@msimonds:

That bug has been reported. We are working on a fix and will update you soon.

[msimonds]

nah i got it verified by changing it in my vbseo interface

one more questions

should we submit all 3 links or just one?

[jward]

@msimonds:

Google should be auto-notified when it is created IF you have that feature enabled in your settings.

Just submitting the index should be fine.

[Brandon Sheley]

this looks good, but I think I'll wait a day or two more, seems there are still several bugs,
sounds like a good hack tho :)

[Bandwurm]

I have set "Smart Priority for Show Thread Pages" to Yes, but every Thread show as <priority>1.00</priority>.

(vB 3.5.0)

[jward]

@Bandwurm:

What value did you set for your default show thread priority?

[xtreme-mobile]

just installed seems to be working ok from what i can see

clicks install

good work :D

[Bandwurm]

Default: 0,3.
Perhaps this is only for the first time of generate a sitemap?

[jward]

@Bandwurm:

We'll look into it. With Smart Priority enabled and your default show thread priority at 0.3 there should be some variance.

[Disi]

Well the 404 Error your only get with a vBSEO enables, deaktivate vBseo and verify the page then reactivate it ;)

[noppid]

As I said in this post, https://vborg.vbsupport.ru/showpost.php?p=816680&postcount=55 , the constant VBSEO_ARCHIVE_ROOT is not defined.

Look at your XML files and your sitemap.txt file and you will see the error.


<url>
<loc>http://www.YOURURL.com/forumVBSEO_ARCHIVE_ROOT</loc>
<priority>1</priority>
<lastmod>2005-11-09T18:35:42+00:00</lastmod>
<changefreq>daily</changefreq>
</url>

[Floris]

Very interesting, certainly keeping my eye on this thread ;)

Very nice that it is not encrypted, and very nice that this is free, and doesn't require vBSEO.

[msimonds]

@msimonds:

Google should be auto-notified when it is created IF you have that feature enabled in your settings.

Just submitting the index should be fine.


I do have that feature, but i guess i have not asked a clear question. There are 3 sitemap files generated. Do we need to submit each one to google or just the first one

[iojam]

Disi, dastar
Hi, i've installed the hack and the files are generates successfully, i'e got vBSEO installed too.

But unfortunatly it won't accesp the direct file so i guess the rewriterule wont work correctly
Did you entered the new rewriterule as the *first* rules in .htaccess? It is important for vBSEO-enabled forums.


ConqSoft
Actually, after looking at the sitemap file that was generated, it does include threads from forums that have permissions set.

Any way to add this so that we don't have to worry about keeping the excluded list of forumids up to date?

If the thread/forum isn't visible to guests, then there's really no reason to include it in the sitemap.The forums that are not visible by guests should not be to the sitemap by default. Perhaps you used a "Run now" feature at Admincp->vB scheduler? (in this case the script is running as admin)
Please try the normal way of generator execution:
- vB cron (scheduled)
- system cron
- direct run from vbseo_sitemap/ interface
(non-public should not be included in all these cases)

[ConqSoft]

Yes, I did use the Run Now feature. I tried it using the interface, but even though I had changed the option to allow it to be ran from there, it said I couldn't. So I'll wait until the task executes tonight.

Thanks

[TheComputerGuy]

I try to run it and get this

Fatal error: Call to undefined function: vbseo_thread_url_row() in /home/xxxx/public_html/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 606

[ConqSoft]

Joe,

If your Direct Run Code has a # in it, it won't let you generate the sitemap from the interface because the URL ignores everything after the #. Needs to be URLencoded I guess? (I use upper, lower, and special characters in all my passwords.)

[iojam]

Cedric_FP
Well, as it turns out, folks at vbseo are also having problems with the URL rewrite and the sitemap_1.xml.gz

It probably means google can't get the sitemap eitheThis problem appears with IE only (we fixed it though) - google is downloading and parsing the sitemap files correctly.

msimonds
I do have that feature, but i guess i have not asked a clear question. There are 3 sitemap files generated. Do we need to submit each one to google or just the first one
It is enough to submit the index file only according to Google submit instructions:
http://www.google.com/webmasters/sitemaps/docs/en/submit.html
(the vBSEO Sitemap Generator does it automatically though with "Notify Google" option enabled)

[joeychgo]

I havent installed it yet, but this looks like a pretty good hack.

[iojam]

ConqSoft
Yes, I did use the Run Now feature. I tried it using the interface, but even though I had changed the option to allow it to be ran from there, it said I couldn't. So I'll wait until the task executes tonight.

Please make sure that you have "Run from vB Scheduled Tasks Manager ONLY" set to "No".


TheComputerGuy
I try to run it and get this

Fatal error: Call to undefined function: vbseo_thread_url_row() in /home/xxxx/public_html/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 606If you are using vBSEO, ensure to install the latest (2.2.0) version which is Sitemap Generator compliant.

[Basit]

Great Hack, waiting for this for a long time.
Worked fine with Google BUT for Yahoo created a file of over 110MB now when I upload this file to yahoo it gives me timeout. Any solution ?

[hotrod1]

Awesome, awesome job thanks!

[vBSEO]

As I said in this post, https://vborg.vbsupport.ru/showpost.php?p=816680&postcount=55 , the constant VBSEO_ARCHIVE_ROOT is not defined.

Look at your XML files and your sitemap.txt file and you will see the error.


<url>
<loc>http://www.YOURURL.com/forumVBSEO_ARCHIVE_ROOT</loc>
<priority>1</priority>
<lastmod>2005-11-09T18:35:42+00:00</lastmod>
<changefreq>daily</changefreq>
</url>


Hello noppid,

VBSEO_ARCHIVE_ROOT is used for vBSEO-enabled forums only. Try disabling it via the admincp (first option).

[ConqSoft]

ConqSoft

Please make sure that you have "Run from vB Scheduled Tasks Manager ONLY" set to "No".




Yes, I do. See my other reply. It was due to my Direct Access Code having a # in it, and that being passed on the URL, which ignores everything after that.

[iojam]

Ah, ok. ;)

[noppid]

Hello noppid,

VBSEO_ARCHIVE_ROOT is used for vBSEO-enabled forums only. Try disabling it via the admincp (first option).


That is disabled.

The constant is used in this hack, but apparently defined in the vBSEO paid hack only. Therefore when you run this, one of the URL's in the xml sitemap file and the yahoo sitemap.txt file contain the constant in it's raw form. I've looked at the map of users of this hack and they have it in their xml files too. I fixed mine myself, thanks for the code.

You need a if notdefined define in the functions file of this hack for VBSEO_ARCHIVE_ROOT or something.

[T2DMan]

Well done vBSEO for a great product - so many options, lots of bells and whistles.

Yes, I support this sitemap product over my own version, at least once they have the bugs fixed up. It did peeve me off for a while that they were producing this, but when I saw the bells and whistles of the product I felt a bit more resigned to the idea of supporting it, and started giving them lots of pointers... Note the credits on the index.php file of their product - includes me - Michael Brandon.

[noppid]

Well done vBSEO for a great product - so many options, lots of bells and whistles.

Yes, I support this sitemap product over my own version, at least once they have the bugs fixed up. It did peeve me off for a while that they were producing this, but when I saw the bells and whistles of the product I felt a bit more resigned to the idea of supporting it, and started giving them lots of pointers... Note the credits on the index.php file of their product - includes me - Michael Brandon.

Good show T2DMan!

I use your code on my 3.0.x forum. Very good code as well! Thanks for putting it out for us.

[Hornstar]

Im using 3.5.1 I'm going to install this now, and report back, this is will save alot of time if it works good, thanks

[Cedric_FP]

Cedric_FP
This problem appears with IE only (we fixed it though) - google is downloading and parsing the sitemap files correctly.

msimonds

It is enough to submit the index file only according to Google submit instructions:
http://www.google.com/webmasters/sitemaps/docs/en/submit.html
(the vBSEO Sitemap Generator does it automatically though with "Notify Google" option enabled)

Well, is this problem fixed in our versions or what? How do we fix the issue?

[iojam]

@Cedric_FP,

this thread will be updated with a new release that includes this and other bug-fixes.

@noppid
That is disabled. The most URLs from archive are added correctly with vBSEO disabled.. except of archive homepage! :) (this is fixed too and will be included in updated Sitemap generator)

@T2DMan
Thanks for your valuable input, Michael! :)

[noppid]

@Cedric_FP,

this thread will be updated with a new release that includes this and other bug-fixes.

@noppid
The most URLs from archive are added correctly with vBSEO disabled.. except of archive homepage! :) (this is fixed too and will be included in updated Sitemap generator)

@T2DMan
Thanks for your valuable input, Michael! :)

Very minor, but worth pointing out. This is an outstanding tool!

[Cedric_FP]

Good to hear! Keep up the good work, this is definitely a useful little add-in!

[amc]

I get the following Fatal Error message after running about 40 lines (see below):

[homepage] [2,673.8Kb mem used] [0s (+0)]
[SECTION START] forumdisplay [2,674.0Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 3, total threads: 0, pages: 0 [2,674.1Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 40, total threads: 0, pages: 0 [2,674.0Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 59, total threads: 8, pages: 1 [2,674.0Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 48, total threads: 1058, pages: 53 [2,678.3Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 5, total threads: 0, pages: 0 [2,689.9Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 18, total threads: 1544, pages: 78 [2,689.9Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 45, total threads: 43, pages: 3 [2,707.0Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 47, total threads: 8, pages: 1 [2,707.7Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 46, total threads: 19, pages: 1 [2,707.9Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 66, total threads: 14, pages: 1 [2,708.1Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 67, total threads: 2, pages: 1 [2,708.3Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 68, total threads: 17, pages: 1 [2,708.5Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 69, total threads: 48, pages: 3 [2,708.7Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 70, total threads: 17, pages: 1 [2,709.4Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 71, total threads: 27, pages: 2 [2,709.6Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 61, total threads: 0, pages: 0 [2,710.0Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 20, total threads: 54, pages: 3 [2,710.0Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 63, total threads: 13, pages: 1 [2,710.7Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 38, total threads: 216, pages: 11 [2,711.0Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 72, total threads: 16, pages: 1 [2,713.5Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 42, total threads: 20, pages: 1 [2,713.8Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 56, total threads: 24, pages: 2 [2,714.1Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 62, total threads: 49, pages: 3 [2,714.6Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 64, total threads: 0, pages: 0 [2,715.2Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 26, total threads: 94, pages: 5 [2,715.2Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 51, total threads: 37, pages: 2 [2,716.4Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 11, total threads: 0, pages: 0 [2,716.9Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 31, total threads: 172, pages: 9 [2,716.9Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 73, total threads: 19, pages: 1 [2,718.9Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 74, total threads: 1, pages: 1 [2,719.1Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 75, total threads: 72, pages: 4 [2,719.3Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 76, total threads: 4, pages: 1 [2,720.2Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 77, total threads: 8, pages: 1 [2,720.4Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 30, total threads: 53, pages: 3 [2,720.6Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 78, total threads: 5, pages: 1 [2,721.3Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 79, total threads: 2, pages: 1 [2,721.6Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 80, total threads: 6, pages: 1 [2,721.8Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 81, total threads: 2, pages: 1 [2,722.0Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 32, total threads: 118, pages: 6 [2,722.2Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 43, total threads: 15, pages: 1 [2,723.6Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 34, total threads: 21, pages: 2 [2,723.9Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 12, total threads: 0, pages: 0 [2,724.4Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 57, total threads: 135, pages: 7 [2,724.4Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 35, total threads: 53, pages: 3 [2,726.0Kb mem used] [0s (+0)]
[SECTION START] showthread [2,726.7Kb mem used] [0s (+0)]

Fatal error: Allowed memory size of 8388608 bytes exhausted (tried to allocate 1024 bytes) in /home/webadmin/domain.com/html/includes/functions_vbseo.php on line 639

[iojam]

amc,

we've improved the memory management in the script to avoid "memory exhausted" problem (according to previous reports) - the vBSEO Sitemap release will be updated here soon.

[amc]

amc,

we've improved the memory management in the script to avoid "memory exhausted" problem (according to previous reports) - the vBSEO Sitemap release will be updated here soon.

Great! I'll be looking forward for the new release.

[KarateKid]

How long should it usually take to generate the sitemap?

I waited for over 15mins for my forum (~460.000 posts) and after the following output, nothing happened:

.
.
.
[SECTION START] showthread [3,994.9Kb mem used] [2s (+0)]

The loading simply stopped...!? And the reports are empty, as well.

[ConqSoft]

Shouldn't take that long. Mine takes about a minute for 350k posts.

[vBSEO]

Thank-you all for your feedback :)

Version 1.1 has been released. See release notes at top for details.

[Cedric_FP]

How should we go about upgrading from version 1.0?

[aacircle]

So what are the steps to upgrade? Would we need to do a complete reinstall after removing the old files?

haha Cedric_FP ... u beat me to the question! :disappointed:

[vBSEO]

Yes,

- Re-upload your 'vbseo_sitemap' folder along with all the files in it
- Make sure your 'vbseo_sitemap/data/' folder is CHMOD to 777
- Remove your vBSEO Sitemap product via your admincp
- Upload the new vbseo_sitemap.xml product file
- Modify your sitemap settings via your admincp
- Enter your password in your Direct Script Run Code field

No changes are required to your Task Schedule settings.

That's it!

[KarateKid]

Yes,

- Re-upload your 'vbseo_sitemap' folder along with all the files in it
- Make sure your 'vbseo_sitemap/data/' folder is CHMOD to 777
- Remove your vBSEO Sitemap product via your admincp
- Upload the new vbseo_sitemap.xml product file
- Modify your sitemap settings via your admincp
- Enter your password in your Direct Script Run Code field

No changes are required to your Task Schedule settings.

That's it!

looks good for me now. Working well...didn't expect, that I've so many urls :D I'm now very excited if google is indexing almost all of them.

[HC.]

new install error
XML Error: unknown at Line 0
when adding it to the import???????????

[jward]

Jon,

Make sure you are uploading the XML file through the 'Manage Products' area and not the 'Add New Plugin' area.

[HC.]

I did that wait for a link for a video

[HC.]

here ya go
no swf files here crap
I will send it to ya

[HC.]

I will put it on my server and send a link

[jward]

Ok Jon - we'll look into that and get back to you ASAP.

[HC.]

jward,
sent
you should have it and the offer

[HC.]

email or pm me on TOS
IT is late i will install it tomorrow
tell JUAN this is what I was talking about on the phone need a seperate place for this on TOS

[HC.]

jward,
that worked thanks for the pm you might want to get that changed in the inscrutions so that no one else gets confussed

[HC.]

'vbroot/.htaccess' will not save?

[jward]

Jon,

You're running vBSEO 2.2.0 - so you already have the necessary .htaccess directives in place.

[HC.]

Joe,
where should I see or type in to see what has been created?
IE..... pic 2 and 3 on the mod?

[jward]

<a href="http://www.yourdomain.com/forums/vbseo_sitemap/index.php" target="_blank">http://www.yourdomain.com/forums/vbs...emap/index.php</a>

[MrNase]

Here's what I got with 1.0 and what I still get with 1.1 :(



Warning: array_merge() [function.array-merge]: Argument #2 is not an array in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 122

Warning: array_merge() [function.array-merge]: Argument #2 is not an array in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 122

Warning: array_merge() [function.array-merge]: Argument #2 is not an array in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 122

Warning: array_merge() [function.array-merge]: Argument #2 is not an array in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 122

Warning: array_unique() [function.array-unique]: The argument should be an array in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 126

Warning: array_merge() [function.array-merge]: Argument #2 is not an array in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 122

Warning: array_merge() [function.array-merge]: Argument #2 is not an array in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 122

Warning: array_merge() [function.array-merge]: Argument #2 is not an array in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 122

Warning: array_merge() [function.array-merge]: Argument #2 is not an array in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 122

Warning: array_merge() [function.array-merge]: Argument #2 is not an array in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 122

Warning: array_unique() [function.array-unique]: The argument should be an array in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 126

Warning: array_merge() [function.array-merge]: Argument #2 is not an array in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 122

Warning: array_merge() [function.array-merge]: Argument #2 is not an array in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 122

Warning: array_merge() [function.array-merge]: Argument #2 is not an array in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 122

Warning: array_merge() [function.array-merge]: Argument #2 is not an array in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 122

Warning: array_merge() [function.array-merge]: Argument #2 is not an array in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 122

Warning: array_unique() [function.array-unique]: The argument should be an array in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 126

Warning: array_merge() [function.array-merge]: Argument #2 is not an array in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 122

Warning: array_merge() [function.array-merge]: Argument #2 is not an array in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 122

Warning: array_merge() [function.array-merge]: Argument #2 is not an array in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 122

Warning: array_merge() [function.array-merge]: Argument #2 is not an array in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 122

Warning: array_unique() [function.array-unique]: The argument should be an array in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 126

Warning: array_merge() [function.array-merge]: Argument #2 is not an array in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 122

Warning: array_merge() [function.array-merge]: Argument #2 is not an array in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 122

Warning: array_merge() [function.array-merge]: Argument #2 is not an array in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 122

Warning: array_unique() [function.array-unique]: The argument should be an array in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 126

Warning: array_merge() [function.array-merge]: Argument #2 is not an array in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 122

Warning: array_unique() [function.array-unique]: The argument should be an array in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 126
[homepage] [3,710.5Kb mem used] [0s (+0)]
[SECTION START] forumdisplay [3,712.4Kb mem used] [0s (+0)]

Warning: Invalid argument supplied for foreach() in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 155
[SECTION START] showthread [3,716.3Kb mem used] [0s (+0)]

Warning: Invalid argument supplied for foreach() in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 202
[archive homepage] [3,710.9Kb mem used] [0s (+0)]
[SECTION START] forumdisplay archived [3,712.8Kb mem used] [0s (+0)]

Warning: Invalid argument supplied for foreach() in /www/htdocs/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 155
[SECTION START] member [3,712.1Kb mem used] [0s (+0)]
[create sitemap file] filename: sitemap_1.xml.gz, number of urls: 983 [4,034.5Kb mem used] [1s (+1)]
[create sitemap in text format] part #1 [4,035.0Kb mem used] [1s (+0)]
[create sitemap index] filename: sitemap_index.xml.gz, number of sitemaps: 1 [3,760.7Kb mem used] [1s (+0)]


It works fine if I set this to 'no':
Select "Yes" to include your forum display pages in your sitemaps (forumdisplay.php)

[BamaStangGuy]

Alright I have a question.

If you set your google sitemap to run every night does that not defeat the purpose of setting how often google should spider your showthread, showposts, and forumdisplay pages?

I mean you are pinging google everynight at 3AM for example are you not telling google to look at all these pages again?

Is this not how it works?

If not how does the every night thing work? Does google just look at the new additions or what?

Thanks

[iojam]

MrNase

please make sure that you uploaded new files - the line numbers correspond to the v1.0 of sitemap generator.

BrentWilson
When sitemap generator submits your sitemap to google, it DOESN'T mean that your pages will be immediately crawled. But this does help google crawler to know the list of pages for your site when it will start indexing it.

http://www.google.com/webmasters/sitemaps/docs/en/faq.html :
We don't guarantee that we'll crawl or index all of your URLs. However, we use the data in your Sitemap to learn about your site's structure, which will allow us to improve our crawler schedule and do a better job crawling your site in the future. In most cases, webmasters will benefit from Sitemap submission, and in no case will you be penalized for it.

[D|ver]

sorry for my noob question, but i want to submit my sitemaps to both google and yahoo manually

which one is for google and which for yahoo?

i have:
sitemap.txt.gz
sitemap_1.xml.gz
...
sitemap_9.xml.gz
sitemap_index.xml.gz

in my data dir

can anybody help?
thank you in advance :)

[reteep]

MrNase

please make sure that you uploaded new files - the line numbers correspond to the v1.0 of sitemap generator.
:

Are you sure that it's not a PHP5 compatibility issue?

[ConqSoft]

If we manually add the sitemap to Google, what URL should we be using?

I used http://www.mysite.com/forums/sitemap_1.xml.gz (which works in my browser), but I got an HTTP 500 error status when I checked Google.

[noppid]

If we manually add the sitemap to Google, what URL should we be using?

I used http://www.mysite.com/forums/sitemap_1.xml.gz (which works in my browser), but I got an HTTP 500 error status when I checked Google.

I only submit sitemap_index.xml.gz. In fact I modified the ping function to only ping that file as well.

[Disi]

the xml.gzfile is for google and the txt for yahoo.

vBSEO Staff

we stille got the Problem with the htaccess file if useing vBSEO and the Google verification file!

[MrNase]

MrNase

please make sure that you uploaded new files - the line numbers correspond to the v1.0 of sitemap generator.



I thought the latest files were already up.. Nevermind, it's working ;)

How can we be sure the files get submitted to Google?



the xml.gzfile is for google and the txt for yahoo.

vBSEO Staff

we stille got the Problem with the htaccess file if useing vBSEO and the Google verification file!

Edit: Seems to be working.. my sitemap was verified :)

[bluenote2]

The sitemaps are stored under forum-root/vbseo_sitemaps/data

Google writes in its FAQ:

Denied URLs
Google has detected some URLs that appear to be at a higher level or different domain than the Sitemap file location. Note that you will not see all denied URLs listed. Rather, Google lists three of them to give you an idea of what types of URLs are being denied. If you receive this error, try moving your Sitemap file to a higher location in your site and submitting again. For instance, if your Sitemap is listed under http://www.example.com/mysite/sitemap.xml, the following URLs are not valid for that sitemap:

http://www.example.com/ - it's at a higher level than the Sitemap
http://www.example.com/yoursite/ - it's in a directory parallel to the Sitemap
http://www.example.com/mysite/yoursite - it's missing the trailing slash

https://www.google.com/webmasters/sitemaps/docs/en/submit.html#ping

That seems to be a major problem, doesn't it?

[ConqSoft]

The .htaccess file allows http://www.example.com/forums/sitemap.xml.gz to work.

[noppid]

The sitemaps are stored under forum-root/vbseo_sitemaps/data

Google writes in its FAQ:

Denied URLs
Google has detected some URLs that appear to be at a higher level or different domain than the Sitemap file location. Note that you will not see all denied URLs listed. Rather, Google lists three of them to give you an idea of what types of URLs are being denied. If you receive this error, try moving your Sitemap file to a higher location in your site and submitting again. For instance, if your Sitemap is listed under http://www.example.com/mysite/sitemap.xml, the following URLs are not valid for that sitemap:

http://www.example.com/ - it's at a higher level than the Sitemap
http://www.example.com/yoursite/ - it's in a directory parallel to the Sitemap
http://www.example.com/mysite/yoursite - it's missing the trailing slash

https://www.google.com/webmasters/sitemaps/docs/en/submit.html#ping

That seems to be a major problem, doesn't it?


I hacked mine and moved them to the root folder. However, that presents a whole new set of problems I have to deal with, not hack release material. no, I didn't set pubic_html writable. :p

But anyway, I thought they had this faked, it apprears to need to be falked from the root folder.

Are you using their .htaccess file?

[bluenote2]

@ConqSoft: I see. Didn't notice the htaccess impact. Smart.

[iojam]

D|ver
sorry for my noob question, but i want to submit my sitemaps to both google and yahoo manually

which one is for google and which for yahoo?
sitemap.txt.gz is for Yahoo submission
sitemap_*.xml.gz are for Google submission

stormblast

Are you sure that it's not a PHP5 compatibility issue?
The PHP5 compatibility was fixed in v1.1 and line numbers you quoted do not correspond to the source code of the latest version.

ConqSoft
If we manually add the sitemap to Google, what URL should we be using?

I used http://www.mysite.com/forums/sitemap_1.xml.gz (which works in my browser), but I got an HTTP 500 error status when I checked Google.
Is it possible that you had a problem with your server in the time when google downloaded the sitemap? If it is visible correctly in browser, googlebot will get it as well. Please try just to resubmit it.

Disi
vBSEO Staff

we stille got the Problem with the htaccess file if useing vBSEO and the Google verification file!If you have a "Redirect to homepage" option selected for "Fille not found" handling AND yo want to see the stats for sitemap at Google, you should *temporarily* disable the option in vbseocp to complete the verification (http://www.vbseo.com/9627-post9.html).

MrNase
How can we be sure the files get submitted to Google?
You can register for Google Webmaster account and manually submit each sitemap file to track its status at http://www.google.com/webmasters/sitemaps

bluenote2
The sitemaps are stored under forum-root/vbseo_sitemaps/data
Alhtough sitemap files are stored in the data folder (to simplify file permissions setup during installation), the URL that is sent to Google links to forumroot. This is achived by using .htaccess mod_rewrite directives.

[Disi]

D|ver
If you have a "Redirect to homepage" option selected for "Fille not found" handling AND yo want to see the stats for sitemap at Google, you should *temporarily* disable the option in vbseocp to complete the verification (http://www.vbseo.com/9627-post9.html).


Well did that of course! But maybe there should be a default rule for those files in vBSEO

[iojam]

Disi,

this is not about the files Google ask you to upload - they perform a request for *random* filename to check if the server returns 404 code. That's why you should set the corresponcing option ("Send 404 HTTP code") in your vBSEO Control Panel.

[kadafi_alive]

Hi,

Everytime I run the scheduled task, it gives me these errors:

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/loadwis/public_html/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 423

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/loadwis/public_html/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 426

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/loadwis/public_html/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 423

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/loadwis/public_html/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 426

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/loadwis/public_html/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 431

Warning: gzclose(): supplied argument is not a valid stream resource in /home/loadwis/public_html/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 432

Warning: gzclose(): supplied argument is not a valid stream resource in /home/loadwis/public_html/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 435
[create sitemap file] filename: sitemap_6.xml.gz, number of urls: 5765 [114s (+3)]
[create sitemap in text format] part #7 [114s (+0)]

Warning: filesize(): Stat failed for /home/loadwis/public_html/forums/vbseo_sitemap/data/sitemap_6.xml.gz (errno=2 - No such file or directory) in /home/loadwis/public_html/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 455

Warning: fopen(/home/loadwis/public_html/forums/vbseo_sitemap/data/sitemap_index.xml.gz): failed to open stream: Permission denied in /home/loadwis/public_html/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 674

Warning: fwrite(): supplied argument is not a valid stream resource in /home/loadwis/public_html/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 675

Warning: fclose(): supplied argument is not a valid stream resource in /home/loadwis/public_html/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 676
[create sitemap index] filename: sitemap_index.xml.gz, number of sitemaps: 6 [114s (+0)]

Warning: fopen(/home/loadwis/public_html/forums/vbseo_sitemap/data/1131699206.log): failed to open stream: Permission denied in /home/loadwis/public_html/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 534

Warning: fwrite(): supplied argument is not a valid stream resource in /home/loadwis/public_html/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 535

Warning: fclose(): supplied argument is not a valid stream resource in /home/loadwis/public_html/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 536

[iojam]

@kadafi_alive,

make sure to set permissions as described in installation instructuions:
1. CHMOD 777 the 'vB-root/vbseo_sitemap/data/' folder

[dastar]

I had to manually move my gzip file into my forum root folder directory (I did include the needed htaccess directive but it just redirects to the forum home page).

[Disi]

@dastar
is the htaccess directive the first entry in your file?

[havefun]

working fine. THX vBSeo-team :)

[msimonds]

i set a cron job in cpanel per your instructions to run at 03:00 hrs each day

I am getting this response from the email

Unable to add cookies, header already sent.
File:
Line: 0





SEO by vBSEO 2.2.0 © 2005, Crawlability, Inc.

Regards
Mike

[jward]

@msimonds:

We'll check into that. An updated release is coming soon.

[iojam]

msimonds,

please try to remove "-q" php command line switch to get it working (seems to be required for vB3.0.x standalone execution to avoid cookie set problem):
"/usr/local/bin/php /path/to/vbroot/vbseo_sitemap/vbseo_sitemap.php"

[jward]

11/11/2005 - Version 1.2 Released
(1) UPDATE: Release notes.
(2) FIX: Google not recognizing the MIME type for the sitemap file correctly (for some server configurations) resulting in a "HTTP 500" error message in the webmaster account page.
(3) FIX: New cron command provided (Removed -q directive).

/usr/local/bin/php /path/to/vbroot/vbseo_sitemap/vbseo_sitemap.php
(4) FIX: .htaccess directives updated.

RewriteEngine On
RewriteRule ^(sitemap.*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]

Upgrade Instructions (Version 1.1 to 1.2)

(1) Upload all new PHP files for version 1.2 to the vbseo_sitemap folder, overwriting the existing ones.
(2) Change the .htaccess directives to the 1.2 version provided.
(3) IF you are using the cron, update the cron command to the 1.2 version provided.

[Hexemer]

Hello,

i hope you understand me, my english is not the best. :ermm:

I have a big forum (Threads: 79.852, Posts: 594.311, Members: 4.769) but don't have a own server. The server has a max execution time for php scripts (set_time_limit) of 30 sec. This is too short to complete the generation of sitemap files so i became a Time out.

I had the same problem with backup the database. The Script "MySQlDumper" (http://www.mysqldumper.de/en/ (http://www.mysqldumper.de/en/)) has a very tricky function:

mysqldumper uses a proprietary technique to avoid execution interruption. It only reads and saves a certain amount of commands and then calls itself via JavaScript and memorizes how far in the process it was and resumes its action from its last standby.


Can you make vBSEO Google/Yahoo Sitemap generator compatible with big forums and the maximum execution time of php scripts, please?

[iojam]

Hexemer,

if you have a maximum execution time set for php scripts, you can execute the script from the SSH (shell) command line:
/usr/local/bin/php /path/to/vbroot/vbseo_sitemap/vbseo_sitemap.php
(command line php config usually doesn't have this restriction).

The SSH access is required for this though.

If you don't have SSH, you can exclude showpost urls from the generated sitemap (in Admincp->vBSEO Sitemap Options) - that will significantly reduce the time required for sitemap generation.

[Vitesse]

Am i being a complete muppet here or something?

exactly what url would i submit to google?

I've tried all the urls to the files in the data folder and none of them seem to work

Also somewhere i saw something mentioned that sitemaps are automatically submitted to google, where do i find this feature as everytime i log onto my google account it says i havnt submitted one yet?

Many thanks

Tom

EDIT: One other thing i was wondering, the google FAQ says that you should have the index file in the uppermost directory or your site, as my site uses a portal and my forums are in www.whatever.com/forums will this prevent anything above the forums from getting crawled (i.e. my photo gallery, tutorials sections etc?)

[ConqSoft]

Use:
http://www.yoursite.com/forums/sitemap_index.xml.gz
(It should work in your browser too, if you go to it, as long as you made the .htaccess changes instructed.)

It will automatically notify Google of your updated sitemap (if you have that option turned on), but it won't show up under your Google Sitemaps account. It's done "behind the scenes". You will have to manually add it if you want to see/track it under your Sitemaps account..

[Vitesse]

Nope, it doesnt work for me :(

My .htaccess is in www.mysite.com/forums folder is that right?

RewriteEngine On
RewriteRule ^(sitemap.*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]


Is that right?

[iojam]

Tom,

after ConqSoft's (absolutely correct) answers, I can only add:

the script submits your sitemap to Google, and NOT to your webmaster account, because there is NO association between your site and your google webmaster account. Within your account you can track multiple sitemaps (including sites that you do not own!) AND vice versa - there may be several accounts that track the same sitemap.

EDIT: One other thing i was wondering, the google FAQ says that you should have the index file in the uppermost directory or your site, as my site uses a portal and my forums are in www.whatever.com/forums will this prevent anything above the forums from getting crawled (i.e. my photo gallery, tutorials sections etc?)Sitemap cannot prevent crawling the site. The "uppermost directory" term means that any URL that link to the upper folder and is included into sitemap will be ignored, which is not the case - all urls created by vBSEO Sitemap Generator will point to your forums/ directory.

[iojam]

My .htaccess is in www.mysite.com/forums folder is that right?
RewriteEngine On
RewriteRule ^(sitemap.*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
That is correct. Please make sure you have mod_rewrite enabled at your host. (look in phpinfo() for that)

Edit: I noticed from the error mesage at your site that you are hosted on IIS. mod_rewrite is an apache module and IIS doesn't support it. The workaround for you is to move all *.xml.gz files from vbseo_sitemap/data/ folder to vbroot/ (the only downside is that you will not be able to see the downloads log in this case).

[Vitesse]

Thanks for your help so far guys, much appreciated :)

EDIT: Yes, it's an IIS based server, so manually move the files to the forum root and all should be good, right?

[iojam]

That's right. When sitemap is regenerated the files should be moved to vbroot again though.

[Vitesse]

Excellent :) Thanks for all your help guys...Much Appreciated :D

[imported_tstaut]

Worked perfectly on my VB3.5 forum running VBSEO. Thanks for a great mod!

(clicked *install* :) )

[caliman]

Ditto. Thanks for this. After reading this thread a lot, it installed perfectly with vB 3.5.1 and vBSEO 2.2.0.


EDIT - I seem to be having a rewrite problem -

http://www.mysite.com/forums/sitemap.txt.gz

I wanted to look at this before submitting to Yahoo. It just redirects to my forum home.

I do have the .htaccess in /forums and other stuff went smoothly - direct run, verify with Google..

Edit 2- For now I copied my .gz files to /forums. Still curious why the rewrite didn't work.

[iojam]

caliman,

do you have correct rewrite rule in .htaccess? (it was slightly changed in the latest version of vBSEO Sitemap Generator):
RewriteRule ^(sitemap.*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]

[Hexemer]

Hexemer,

if you have a maximum execution time set for php scripts, you can execute the script from the SSH (shell) command line:
/usr/local/bin/php /path/to/vbroot/vbseo_sitemap/vbseo_sitemap.php
(command line php config usually doesn't have this restriction).

The SSH access is required for this though.

If you don't have SSH, you can exclude showpost urls from the generated sitemap (in Admincp->vBSEO Sitemap Options) - that will significantly reduce the time required for sitemap generation.

PHP isn't installed at my ssh server, so i can't use it. The generator only works when I activate the archive pages. :ermm:

Can you help me, please?

[Cedric_FP]

If we are upgrading from 1.1, do I need to reupload the XML product?

[caliman]

caliman,

do you have correct rewrite rule in .htaccess? (it was slightly changed in the latest version of vBSEO Sitemap Generator):

THat was it. Thank you Oleg!

[caliman]

One thing... looking at my generator history.. the first was direct access, but the others were my 3am cron - looks like I need to set a minute setting? I am just using *. What is correct? Or is something else wrong?

Sitemap Generator History
No Date Run Time Total URLs Change Google Notify Details
1 2005-11-13 01:34 19.57 s 60,651 - Yes View details | Remove record
2 2005-11-13 03:02 19.28 s 60,653 +2 Yes View details | Remove record
3 2005-11-13 03:03 14.98 s 60,653 - Yes View details | Remove record
4 2005-11-13 03:10 19.20 s 60,654 +1 Yes View details | Remove record
5 2005-11-13 03:20 15.78 s 60,654 - Yes View details | Remove record
6 2005-11-13 03:21 15.55 s 60,654 - Yes View details | Remove record
7 2005-11-13 03:22 15.58 s 60,654 - Yes View details | Remove record
8 2005-11-13 03:23 15.33 s 60,654 - Yes View details | Remove record
9 2005-11-13 03:24 15.04 s 60,654 - Yes View details | Remove record
10 2005-11-13 03:32 15.44 s 60,654 - Yes View details | Remove record
11 2005-11-13 03:32 15.25 s 60,654 - Yes View details | Remove record
12 2005-11-13 03:41 15.17 s 60,654 - Yes View details | Remove record
13 2005-11-13 03:42 14.89 s 60,654 - Yes View details | Remove record
14 2005-11-13 03:43 15.09 s 60,654 - Yes View details | Remove record
15 2005-11-13 03:44 14.93 s 60,654 - Yes View details | Remove record
16 2005-11-13 03:45 15.18 s 60,654 - Yes View details | Remove record
17 2005-11-13 03:49 17.27 s 60,654 - Yes View details | Remove record
18 2005-11-13 03:50 15.16 s 60,654 - Yes View details | Remove record
19 2005-11-13 03:51 18.30 s 60,654 - Yes View details | Remove record
20 2005-11-13 03:52 17.96 s 60,654 - Yes View details | Remove record
21 2005-11-13 03:53 15.22 s 60,654 - Yes View details | Remove record
22 2005-11-13 03:54 15.43 s 60,654 - Yes View details | Remove record
23 2005-11-13 03:55 15.60 s 60,654 - Yes View details | Remove record
24 2005-11-13 03:56 15.63 s 60,654 - Yes View details | Remove record
25 2005-11-13 04:13 15.05 s 60,654 - Yes View details | Remove record

[ConqSoft]

Yes, if you don't set the minute it will run every minute.

[puertoblack2003]

i must say this is a wonderful program

i'm stuck on 1 thing i think :ermm: on this part here in admincp :Important: Enter your Direct Script Run Code (this is also your password for your automated reports) .........what run code do i put in there i'm a neebie but learning thanks :disappointed:

[caliman]

Think of it as a numerical password that you make up.

Yes, if you don't set the minute it will run every minute.

Jeez.. I feel stupid. :rolleyes:
Thanks Conq!

[sportsoutlaw]

quick question on this hack.

Since this is a sitemap for the forum, what happens to my other pages that are indexed already by google? Will it cause problems for the pages that are not part of the forums?

[iojam]

@nievesidenshop
i'm stuck on 1 thing i think on this part here in admincp :Important: Enter your Direct Script Run Code (this is also your password for your automated reports) .........what run code do i put in there i'm a neebie but learning thanks This is a password you will need to access "vbseo_sitemap/" pages.

Since this is a sitemap for the forum, what happens to my other pages that are indexed already by google? Will it cause problems for the pages that are not part of the forums?Sitemap doesn't affect pages that are not included into sitemap file.

[jayhawk785]

2 things...

1. you say to add urls to "extra_urls.txt" - the zip I downloaded didn't include that so I'm unsure where it should be and how the URL's should be entered.

2. your instructions say to chmod the data directory--you might want to tell people to create it as well, since it isn't already in there. It's fairly obvious, but still :)

help on #1 appreciated.

[ConqSoft]

2. The data directory was included with the ZIP file for me.

[puertoblack2003]

thank you sir finally got my last problem solved after going to some problems i think i have it going. *****INSTALLED**********

[sportsoutlaw]

I went to my root file to change the .htaccess file and I have 3 htaccess files.

.htaccess - has nothing about mod rewrite in the code.
.htaccess.1097424490 - has mod rewrite info in it and turned on
.htaccess.1117989058 - has mod rewrite info in it and turned on.

I dont know which one to add the code to.

[sportsoutlaw]

nevermind, got that figured out.

[jward]

For those of you installing this mod, we also recommend that you install:

vBSEO Conditional Signatures for vBulletin 3.5.x:
https://vborg.vbsupport.ru/showthread.php?t=97685 (https://vborg.vbsupport.ru/showthread.php?t=97685)

[sportsoutlaw]

Ok, another question (complete newbie here)

I have set this up, and I have run the generator via my admin CP. From my understanding of sitemap generators, I am supposed to submit these to google. How do I do that?

[iojam]

jayhawk785
1. you say to add urls to "extra_urls.txt" - the zip I downloaded didn't include that so I'm unsure where it should be and how the URL's should be entered.
This file is located in vbseo_sitemap/ folder (it's empty by default) and you may add additional URLs in "url,frequency,priority" format, like:
http://yourdomain/page.html,daily,1.0

2. your instructions say to chmod the data directory--you might want to tell people to create it as well, since it isn't already in there. It's fairly obvious, but still
"vbseo_sitemap/data/" folder is included in the zip archive. It is empty - may be your archiver software doesn't extract empty diretories? (btw, "extra_urls.txt" file is also included in archive :) )

[iojam]

I have set this up, and I have run the generator via my admin CP. From my understanding of sitemap generators, I am supposed to submit these to google. How do I do that?The script automatically submits your sitemap to google when "Notify Google" option in admincp is enabled.

[sportsoutlaw]

Thanks. I have this set to run daily. Since google is automatically notified, is it a good idea to leave it daily, or reduce that to weekly or monthly?

In other words, is it going to hurt for google to get a daily notification?

[amykhar]

I'm having a strange problem that I don't see anybody else mentioning. I have my options set to create a yahoo style sitemap, but it is not being created that I can see. I don't see it in the data directory and if I go to http://www.eaforums.com/forums/sitemap.txt I get an error: Sitemap file not found

Here is the info if I run the scheduled task manually:
------------
vBSEO - Create Google/Yahoo Sitemap
[homepage] [0s (+0)]
[SECTION START] forumdisplay [0s (+0)]
[forumdisplay] forum_id: 21, total threads: 0, pages: 0 [0s (+0)]
[forumdisplay] forum_id: 110, total threads: 3, pages: 1 [0s (+0)]
[forumdisplay] forum_id: 41, total threads: 75, pages: 4 [0s (+0)]
[forumdisplay] forum_id: 222, total threads: 1, pages: 1 [0s (+0)]
[forumdisplay] forum_id: 218, total threads: 0, pages: 0 [0s (+0)]
[forumdisplay] forum_id: 217, total threads: 0, pages: 0 [0s (+0)]
[forumdisplay] forum_id: 223, total threads: 0, pages: 0 [0s (+0)]
[forumdisplay] forum_id: 221, total threads: 0, pages: 0 [0s (+0)]
[forumdisplay] forum_id: 6, total threads: 0, pages: 0 [0s (+0)]
[forumdisplay] forum_id: 3, total threads: 831, pages: 42 [0s (+0)]
[forumdisplay] forum_id: 154, total threads: 114, pages: 6 [0s (+0)]
[forumdisplay] forum_id: 176, total threads: 0, pages: 0 [0s (+0)]
[forumdisplay] forum_id: 180, total threads: 67, pages: 4 [0s (+0)]
[forumdisplay] forum_id: 58, total threads: 634, pages: 32 [0s (+0)]
[forumdisplay] forum_id: 143, total threads: 0, pages: 0 [0s (+0)]
[forumdisplay] forum_id: 28, total threads: 848, pages: 43 [0s (+0)]
[forumdisplay] forum_id: 152, total threads: 109, pages: 6 [0s (+0)]
[forumdisplay] forum_id: 153, total threads: 336, pages: 17 [0s (+0)]
[forumdisplay] forum_id: 182, total threads: 0, pages: 0 [0s (+0)]
[forumdisplay] forum_id: 37, total threads: 1141, pages: 58 [0s (+0)]
[forumdisplay] forum_id: 158, total threads: 0, pages: 0 [0s (+0)]
[forumdisplay] forum_id: 23, total threads: 3395, pages: 170 [0s (+0)]
[forumdisplay] forum_id: 133, total threads: 237, pages: 12 [0s (+0)]
[forumdisplay] forum_id: 149, total threads: 1166, pages: 59 [0s (+0)]
[forumdisplay] forum_id: 60, total threads: 1190, pages: 60 [0s (+0)]
[forumdisplay] forum_id: 27, total threads: 2420, pages: 121 [0s (+0)]
[forumdisplay] forum_id: 164, total threads: 324, pages: 17 [0s (+0)]
[forumdisplay] forum_id: 24, total threads: 233, pages: 12 [0s (+0)]
[forumdisplay] forum_id: 72, total threads: 47, pages: 3 [0s (+0)]
[forumdisplay] forum_id: 76, total threads: 3, pages: 1 [0s (+0)]
[forumdisplay] forum_id: 78, total threads: 40, pages: 2 [0s (+0)]
[forumdisplay] forum_id: 177, total threads: 0, pages: 0 [0s (+0)]
[forumdisplay] forum_id: 39, total threads: 673, pages: 34 [0s (+0)]
[forumdisplay] forum_id: 80, total threads: 910, pages: 46 [0s (+0)]
[forumdisplay] forum_id: 49, total threads: 3018, pages: 151 [0s (+0)]
[forumdisplay] forum_id: 59, total threads: 1168, pages: 59 [0s (+0)]
[forumdisplay] forum_id: 183, total threads: 0, pages: 0 [0s (+0)]
[forumdisplay] forum_id: 192, total threads: 15, pages: 1 [0s (+0)]
[forumdisplay] forum_id: 208, total threads: 6, pages: 1 [0s (+0)]
[forumdisplay] forum_id: 209, total threads: 8, pages: 1 [0s (+0)]
[forumdisplay] forum_id: 211, total threads: 9, pages: 1 [0s (+0)]
[forumdisplay] forum_id: 224, total threads: 85, pages: 5 [0s (+0)]
[forumdisplay] forum_id: 213, total threads: 60, pages: 3 [0s (+0)]
[forumdisplay] forum_id: 206, total threads: 1, pages: 1 [0s (+0)]
[forumdisplay] forum_id: 225, total threads: 4, pages: 1 [0s (+0)]
[forumdisplay] forum_id: 62, total threads: 0, pages: 0 [0s (+0)]
[forumdisplay] forum_id: 63, total threads: 3509, pages: 176 [0s (+0)]
[forumdisplay] forum_id: 83, total threads: 1, pages: 1 [0s (+0)]
[forumdisplay] forum_id: 85, total threads: 448, pages: 23 [0s (+0)]
[forumdisplay] forum_id: 109, total threads: 36, pages: 2 [0s (+0)]
[forumdisplay] forum_id: 106, total threads: 34, pages: 2 [0s (+0)]
[forumdisplay] forum_id: 89, total threads: 26, pages: 2 [0s (+0)]
[forumdisplay] forum_id: 165, total threads: 0, pages: 0 [0s (+0)]
[forumdisplay] forum_id: 171, total threads: 0, pages: 0 [0s (+0)]
[forumdisplay] forum_id: 168, total threads: 0, pages: 0 [0s (+0)]
[forumdisplay] forum_id: 167, total threads: 0, pages: 0 [0s (+0)]
[forumdisplay] forum_id: 166, total threads: 0, pages: 0 [0s (+0)]
[forumdisplay] forum_id: 173, total threads: 0, pages: 0 [0s (+0)]
[forumdisplay] forum_id: 172, total threads: 0, pages: 0 [0s (+0)]
[forumdisplay] forum_id: 169, total threads: 0, pages: 0 [0s (+0)]
[forumdisplay] forum_id: 170, total threads: 0, pages: 0 [0s (+0)]
[SECTION START] showthread [0s (+0)]
[create sitemap file] filename: sitemap_1.xml.gz, number of urls: 10000 [4s (+4)]
[create sitemap in text format] part #2 [4s (+0)]
[create sitemap file] filename: sitemap_2.xml.gz, number of urls: 10000 [9s (+5)]
[create sitemap in text format] part #3 [9s (+0)]
[archive homepage] [13s (+4)]
[SECTION START] forumdisplay archived [13s (+0)]
[SECTION START] showthread archived [13s (+0)]
[create sitemap file] filename: sitemap_3.xml.gz, number of urls: 10000 [14s (+1)]
[create sitemap in text format] part #4 [14s (+0)]
[create sitemap file] filename: sitemap_4.xml.gz, number of urls: 10000 [16s (+2)]
[create sitemap in text format] part #5 [16s (+0)]
[create sitemap file] filename: sitemap_5.xml.gz, number of urls: 9404 [18s (+2)]
[create sitemap in text format] part #6 [18s (+0)]
[create sitemap index] filename: sitemap_index.xml.gz, number of sitemaps: 5 [18s (+0)]

Done

[dieselpowered]

OK a few things that I found...if these have been mentioned by apologies:

First, the instructions states to chmod the data folder to 777...there is not data folder, do we create one?

Second, the instructions want you to open vbroot/.htaccess there is not one...do we use the one included with the package?

Thanks everyone :)

[sportsoutlaw]

OK a few things that I found...if these have been mentioned by apologies:

First, the instructions states to chmod the data folder to 777...there is not data folder, do we create one?

Second, the instructions want you to open vbroot/.htaccess there is not one...do we use the one included with the package?

Thanks everyone :)

If you uploaded the proper files, the data folder is there.

.htaccess is not there by default in vB, you have to create it. My host informed me of that today.

[sportsoutlaw]

I'm having a strange problem that I don't see anybody else mentioning. I have my options set to create a yahoo style sitemap, but it is not being created that I can see. I don't see it in the data directory and if I go to http://www.eaforums.com/forums/sitemap.txt I get an error: Sitemap file not found


I was curious about the same thing, but from what I can tell, there simply isnt anything that can be submitted to yahoo. I just assumed it was putting some sort of .txt sitemap somewhere in a folder for yahoo to find since I dont see how you can submit anything to yahoo other than your main URL.

To add - I really dont see a reason to need a yahoo sitemap, as yahoo seems to have all my pages indexed.

[dieselpowered]

If you uploaded the proper files, the data folder is there.

.htaccess is not there by default in vB, you have to create it. My host informed me of that today.

There is no 'data' folder in the vbseo sitemap directory.

I noticed an .htaccess file though came with the package...should be just use that one?

[sportsoutlaw]

There is no 'data' folder in the vbseo sitemap directory.

I noticed an .htaccess file though came with the package...should be just use that one?

In my CP, when I click on the vbseo_sitemap folder, there is a data folder, along with 5-6 other folders, including the extra-urls.txt file.

I had to go to my foot folder for my forum and create a text file called .htaccess

[dieselpowered]

In my CP, when I click on the vbseo_sitemap folder, there is a data folder, along with 5-6 other folders, including the extra-urls.txt file.

I had to go to my foot folder for my forum and create a text file called .htaccess

Here do this...download the package again and unzip it...look inside the vbseo_sitemap folder, there is no 'data' folder.

Also, included in the package is a .htaccess file, I assume we can use this one?

[dieselpowered]

So let me ask you this...is the setting for:

Run from vB Scheduled Tasks Manager ONLY

Better left as yes or no?

Forgive my ignorance, I am completely new to this :)

[KarateKid]

I've a question. Is it normal, that the Download-Log shows that only the index file has been downloaded, or should all the other files also be mentioned? Do I have a problem, when google downloads only the index file? How can I solve this?

[Cedric_FP]

If we are upgrading from 1.1, do I need to reupload the XML product?

From 1.1 to 1.2, do we upload the product again?

[addict]

So let me ask you this...is the setting for:

Run from vB Scheduled Tasks Manager ONLY

Better left as yes or no?

Forgive my ignorance, I am completely new to this :)

If you want to be able to run the sitemap update script via a url trigger (i.e. http://yourdomain.com/forum/vbseo_sitemap/vbseo_sitemap.php?runcode=<password> then set it to 'no'... otherwise you can set it to 'yes'. I have mine set to 'no', so I can rebuild the sitemap just by clicking on a bookmark, but you might have different needs.

I also had a problem early this morning with the sitemap automated task... I had set it to rebuild the sitemap on Sunday at 2am, and it rebuilt the sitemap three times... at 2am, 2:02am and 2:04am... I looked at the automated task I had created, and it said "Sun 0200", so I hope there's not some kind of bug in the task script.
For the time being I'll just run the task manually, until I can figure out what's going on... I just thought I'd mention it though.

Otherwise, this is great stuff! Thanks!

[iojam]

sportsoutlaw
Thanks. I have this set to run daily. Since google is automatically notified, is it a good idea to leave it daily, or reduce that to weekly or monthly?

In other words, is it going to hurt for google to get a daily notification?
Google does NOT apply any penalty based on how often do you submit your sitemap.

amykhar
I'm having a strange problem that I don't see anybody else mentioning. I have my options set to create a yahoo style sitemap, but it is not being created that I can see. I don't see it in the data directory and if I go to http://www.eaforums.com/forums/sitemap.txt I get an error: Sitemap file not found
The latest version of vBSEO Sitemap generator creates compressed files for Yahoo sitemap. :) So, you should look for (and submit to Yahoo) http://www.eaforums.com/forums/sitemap.txt.gz
Do not forget to update .htaccess according to the latest installation instructins:
RewriteRule ^(sitemap.*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]

xtremeoff-road
1. An empty "vbseo_sitemap/data/" folder is included in archive. Make sure that your archiver software is configured to extract empty folders. Otherwise, just create "vbseo_sitemap/data/" folder manually and chmod 0777 it.
2. If you don't have .htaccess currently in vbroot, you can simply upload one included in archive.
3.
So let me ask you this...is the setting for:

Run from vB Scheduled Tasks Manager ONLY

Better left as yes or no?
"Run from vB Scheduled Tasks Manager ONLY" option is set to "Yes" by default because you have empty "Run code" initially and anyone can access your "vbseo_sitemap/" interface. After you have "Run code" set to the password of your choice, feel free to set "Run from vB Scheduled Tasks Manager ONLY" to "No" to allow you ro run generator manually when you need this. :)

KarateKid
I've a question. Is it normal, that the Download-Log shows that only the index file has been downloaded, or should all the other files also be mentioned? Do I have a problem, when google downloads only the index file? How can I solve this?
According to Google submission instructions, they will extract all your sitemap files based on the index file entries.
http://www.google.com/webmasters/sitemaps/docs/en/submit.html :
Note: If you are providing a Sitemap index file, you only need to issue one HTTP request that includes the location of the Sitemap index file; you do not need to issue individual requests for each Sitemap listed in the index.
However I noticed that it takes quite some time for them to do it and this can be accomplished MUCH faster if you submit EACH sitemap file to your google webmaster account (https://www.google.com/webmasters/sitemaps). :)

Cedric_FP

From 1.1 to 1.2, do we upload the product again?For the 1.1->1.2 upgrade it is not required to reinstall xml product file. Make sure that you have your .htaccess entry updated along with uploading of the new php files.

addict
Make sure that you have "Minutes" to "0" in your your vB Admincp->Scheduler ("*" option means running every miunute!).

[Doc Great]

Your products work perfectly! Thanks for sharing it :)

PS: you find the german translation (xml & files) @ http://www.vbhacks-germany.com/forum/showthread.php?t=2243

Yours,
Sven

EDIT: Version 1.2 translated and released @ http://www.vbhacks-germany.com/forum/showthread.php?t=2284

[amykhar]

Thanks, Juan. That fixed my problem.

[acorndomains.co]

I tried to submit my sitemap.txt twice to Yahoo, but their server timed out.
Just click submit again, it worked for us the 2nd time.

[kadafi_alive]

Hi,

Regarding the new cron command

What do I exactly add?

/usr/local/bin/php /path/to/vbroot/vbseo_sitemap/vbseo_sitemap.php

Thanks in advance

Regards

[msimonds]

msimonds,

please try to remove "-q" php command line switch to get it working (seems to be required for vB3.0.x standalone execution to avoid cookie set problem):


Nope that did not work, i will try it via the admincp cron

[007]

Is this working for everyone on 3.5.1? It looks like mixed reviews so far, so I want to be sure before trying it out. Thanks!

[amykhar]

It's working fine for me on 3.5.1.

Amy

[jward]

@Doc Great:

Thank-you for the translations Sven - greatly appreciated. :)

[vBSEO]

Thanks, Juan. That fixed my problem.Thank-you Amy. I am honored to be mistaken for Oleg, he is one of the most talented persons I know ;)

[dboogie2288]

Downloaded, Installed, Works fine it seems.

However, everything runs smoothly on my side, when google picks it up, I get A "URL not under Sitemap path" error on 3 links in each one of the packages that is containing 20000 URLS. Any ideas????

URL Error
http://www.beginnerbikers.org/showthread.php?t=596&page=2 URL not under Sitemap path
http://www.beginnerbikers.org/showthread.php?t=83&page=2 URL not under Sitemap path
http://www.beginnerbikers.org/showthread.php?t=929 URL not under Sitemap path

http://www.beginnerbikers.org/showthread.php?t=861 URL not under Sitemap path
http://www.beginnerbikers.org/showthread.php?t=960 URL not under Sitemap path
http://www.beginnerbikers.org/showthread.php?t=966 URL not under Sitemap path

http://www.beginnerbikers.org/showthread.php?t=539 URL not under Sitemap path
http://www.beginnerbikers.org/showthread.php?t=794 URL not under Sitemap path
http://www.beginnerbikers.org/showthread.php?t=912&page=2 URL not under Sitemap path

http://www.beginnerbikers.org/showthread.php?t=3406 URL not under Sitemap path
http://www.beginnerbikers.org/showthread.php?t=3762&page=12 URL not under Sitemap path
http://www.beginnerbikers.org/showthread.php?t=788 URL not under Sitemap path


The index file shows no problems..

[vBSEO]

Hi,

Regarding the new cron command

What do I exactly add?

/usr/local/bin/php /path/to/vbroot/vbseo_sitemap/vbseo_sitemap.php

Thanks in advance

Regards
You should replace "/path/to/vbroot/" with the real path on your server to the vB root folder. For instance, "/home/user/public_html/forums/" - this is different for every host.

Nope that did not work, i will try it via the admincp cron
Does it show the same error with no "-q" in the command line?

Downloaded, Installed, Works fine it seems.

However, everything runs smoothly on my side, when google picks it up, I get A "URL not under Sitemap path" error on 3 links in each one of the packages that is containing 20000 URLS. Any ideas????
Make sure you submit the sitemap files like http://www.beginnerbikers.org/sitemap_1.xml.gz (.htaccess mod_rewrite entry makes it possible) and NOT http://www.beginnerbikers.org/vbseo_sitemap/data/sitemap_1.xml.gz

[Yorixz]

One thing is still not totally clear for me; what's exactly the difference between this mod and the other mod posted on the board that also generates XML sitemaps; that it's for both 3.5 and 3.0? That it has mod_rewrite entries or am I missing something "big"?

[dieselpowered]

I am confused...my task is setup to run at 02:00 AM, however, according to the log it ran this morning at 05:47 AM and yesterday at 06:41 AM

Any thoughts?

TYIA :)

[dboogie2288]

Make sure you submit the sitemap files like http://www.beginnerbikers.org/sitemap_1.xml.gz (.htaccess mod_rewrite entry makes it possible) and NOT http://www.beginnerbikers.org/vbseo_sitemap/data/sitemap_1.xml.gz

Ok, I double checked my .htaccess file, all good and I reran the process, and it's still creating the files in the \data directory. Is there something stupid I am missing, because I consider myself semi-competent. :ermm:

[iojam]

xtremeoff-road,

vB scheduler is executed in the moment when you forums are accessed only.

I.e., the task that is being setup to run at 2AM will be executed with the first hit on forum AFTER 2AM. And in case when forum are not active in the night hours ;), it is possible that this "nearest" hit was at 5:47AM :)

[Algren_San]

INSTALLED :D thanks no problem no errors just FINE on 3.5.0 Gold :) thanks :D

**click on install**

**voting**

**rating**

[iojam]

dboogie2288,

Ok, I double checked my .htaccess file, all good and I reran the process, and it's still creating the files in the \data directory. Is there something stupid I am missing, because I consider myself semi-competent.
The files are *stored* in vbseo_sitemap/data/, but *linked* to the forums root using rewrite entry in .htaccess. And you should submit those "virtual" urls that reside in forums root. Does it make sense? :)

[dieselpowered]

xtremeoff-road,

vB scheduler is executed in the moment when you forums are accessed only.

I.e., the task that is being setup to run at 2AM will be executed with the first hit on forum AFTER 2AM. And in case when forum are not active in the night hours ;), it is possible that this "nearest" hit was at 5:47AM :)

Thanks for the explanation, as well as your continued support of this excellent hack!

[dboogie2288]

dboogie2288,


The files are *stored* in vbseo_sitemap/data/, but *linked* to the forums root using rewrite entry in .htaccess. And you should submit those "virtual" urls that reside in forums root. Does it make sense? :)

Got it, I was reading that it was going to be re-written to the root folder. I'll see what google says. Thanks for the quick replies, awesome plugin...so much easier than the others.

[banshee]

I get this error when I run the program

Fatal error: Call to undefined function: vbseo_thread_url_row() in /home/httpd/vhosts/everything2stroke.com/subdomains/forums/httpdocs/vbseo_sitemap/vbseo_sitemap_functions.php on line 633

It runs through the forum id's fine then bombs out with that error message. If I say no to the Thread in the settings I get this error message

Fatal error: Call to undefined function: vbseo_member_url_row() in /home/httpd/vhosts/everything2stroke.com/subdomains/forums/httpdocs/vbseo_sitemap/vbseo_sitemap_functions.php on line 653

[iojam]

banshee,

if you have vBSEO installed at your forums, make sure it is the latest version (vBSEO 2.2.0 or higher).

[dboogie2288]

One last <dumb> question, is the sitemap.txt.gz file supposed to be submitted?? It's showing too many URLS, I know we can change that if needed, but is that supposed to be included...

I promise, that's the last one. :D

[iojam]

The sitemap.txt.gz file is required for Yahoo submission (http://submit.search.yahoo.com/free/request/).

Your questions are welcomed :)

[cn_de]

toll!

[Cedric_FP]

Do we update the new cron command for the vb scheduled tasks?

EDIT: Because since the update, my scheduled tasks haven't been running it.

[iojam]

Cedric_FP,

vB Scheduler settings are unchanged. Please check if you still have them configured correctly.

[Cedric_FP]

Cedric_FP,

vB Scheduler settings are unchanged. Please check if you still have them configured correctly.

Hmm, that's strange. I haven't change them, yet my sitemap hasn't run for 2 days now.

EDIT: Wait, I see them in the vbseo_sitemap, but it doesn't send me the email anymore. Strange.

[iojam]

Please redownload the hack package - the latest release had a simple email sending block added for testing purposes and not removed for release! This is fixed and archive file updated. :)
Thanks for reporting!

[Cedric_FP]

No problem :) Thanks for the quick fix.

EDIT: FOr some reason, the sitemap.txt.gz always returns as 0.00 kb and is a corrupt archive.

[TnT]

Hi,

vBSEO Google/Yahoo Sitemap Generator runs when vBSEO Installed? is off.
When its on, generating stops here:

[SECTION START] showthread [2,423.1Kb mem used] [0s (+0)]

No files are written. vBSEO itself runs very fine.

Thomas

[dlutt]

* Voted *

How to check if Google gets really notified?

I've enabled "Google notify" but where can I check if I get the HTTP status "200"?

Google shows me that the last submission were on 12. Nov. On this date I've submitted the url to my sitemap index file manually. Google has downloaded it and shows me stats now but I'm not sure that the auto notify works for me.

Allow_url_fopen is disabled also some php functions like shell_exec,system,passthrough.

Does notify works or not?

Daniel

[kadafi_alive]

Okay, this is quite confusing.

I have set up two cronjobs, one in cpanel and one in scheduled task according to the installation file.

Can I ask why we have to setup two crons?

Regards

[iojam]

Cedric_FP,

please make sure that you have correct rewrite rule in your .htaccess (it was changed in v1.2):
RewriteRule ^(sitemap.*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]

TnT,
[SECTION START] showthread [2,423.1Kb mem used] [0s (+0)]

No files are written. vBSEO itself runs very fine.
Sitemap generation may take some time on the large forums, probably your server configuration limits the script execution time and the script timed out? Check your server logs for more details.

dlutt
How to check if Google gets really notified?

I've enabled "Google notify" but where can I check if I get the HTTP status "200"?You can check if Google was notified in the "Reports List" at vbseo_sitemap/index.php?rlist=true, it shows "Yes" in Google NOtify column when 200 code was recevied only.
Google shows me that the last submission were on 12. Nov.
The status at your google webmaster account shows YOUR last submission date, i.e. those made manually from google account page. You can track the last sitemap file download date as it is more important date (basically, it is enough to submit the file only once).

kadafi_alive,
Okay, this is quite confusing.

I have set up two cronjobs, one in cpanel and one in scheduled task according to the installation file.

Can I ask why we have to setup two crons?
You should setup EITHER system cron job OR vB scheduled task, depending on which one your prefer.
Perhaps, we should mention this in installation instructions. :)

[Cedric_FP]

I do have the correct rewrite rules. In the sitemap control panel it says the .txt.gz is 0.00 kb,. and when I try to dl it, the archive is corrupt.

[TundraSoul]

This product creates a sitemap for your forum, but what about any page outside of your forum? If I want them included with the sitemap, do I have to add every page to the extra-urls.txt text file?

I have thousands of pages in other sub directories, and adding them to the txt file is well, impossible. Is there a better solution? Will Google begin to ignore the other pages outside of the sitemap and only spider those listed on the sitemap?

[ConqSoft]

Google has help for generating sitemaps:
https://www.google.com/webmasters/sitemaps/docs/en/faq.html#generator

[iojam]

Cedric_FP

is this your sitemap url: http://www.fictionpost.com/forums/sitemap.txt.gz ? If so, it is downloaded correctly for me (about 32Kb in size)

TundraSoul,

This product creates a sitemap for your forum, but what about any page outside of your forum? If I want them included with the sitemap, do I have to add every page to the extra-urls.txt text file?
The "vBSEO Google/Yahoo Sitemap Generator for vBulletin 3.5.x & vBulletin 3.0.x" is focused on producing the sitemap for vBulletin forum URLs only. I need to find another script to create sitemap for other pages on your site.
Sitemap submission does not prevent Google from crawling pages that are not included into sitemap.

[Cedric_FP]

Cedric_FP

is this your sitemap url: http://www.fictionpost.com/forums/sitemap.txt.gz ? If so, it is downloaded correctly for me (about 32Kb in size)

TundraSoul,


The "vBSEO Google/Yahoo Sitemap Generator for vBulletin 3.5.x & vBulletin 3.0.x" is focused on producing the sitemap for vBulletin forum URLs only. I need to find another script to create sitemap for other pages on your site.
Sitemap submission does not prevent Google from crawling pages that are not included into sitemap.

Hmm.. seems to be working fine now. That's strange. Thanks anyways :)

[NuclioN]

Great mod, installed and working. :)

[futuregizmo]

ok noob question here. i don't have vbseo installed but rather i have DeanC's vbURL Rewrite: https://vborg.vbsupport.ru/showthread.php?t=91324

will this vBSEO Sitemap Generator hack work?

[Macindy]

* Voted *

How to check if Google gets really notified?

I've enabled "Google notify" but where can I check if I get the HTTP status "200"?

Google shows me that the last submission were on 12. Nov. On this date I've submitted the url to my sitemap index file manually. Google has downloaded it and shows me stats now but I'm not sure that the auto notify works for me.

Allow_url_fopen is disabled also some php functions like shell_exec,system,passthrough.

Does notify works or not?

Daniel

I have the same problem as dlutt:
Google doesn't respider my sitemap.

I just played some with the google webfrontend for sitemaps - First I added it and then I removed it again. After this the sitemap doesn't respidered.

Now I added it again in the frontend:
Google got it again, but it doesn't respider it again - every night the cronjob does an update an inform google, but this doesn't do anything.

The spider only comes when I notify Google manually over the frontend

[iojam]

futuregizmo
"vBSEO Google/Yahoo Sitemap Generator for vBulletin 3.5.x & vBulletin 3.0.x" supports only the original vB dynamic URLs and the URLs created by vBSEO.

Macindy
if you had added the sitemap in your google webmaster account, please do not remove it - may be that is the reason.

[funinthesun]

Since installing this I can't see what people are viewing in the who's online. It now just says viewing thread or viewing forum. How can I change this? Also, where is chmod and how do you edit it as I have no idea what it is :nervous: :confused:

[funinthesun]

P.S Also, does this interfere with vBranking as I also have that installed. Thanks :nervous:

[TnT]

TnT,

Sitemap generation may take some time on the large forums, probably your server configuration limits the script execution time and the script timed out? Check your server logs for more details.



Hi,

as i have written: When vBSEO Installed is off, it runs very well.
Runtime: 18.94 s

When i switch vBSEO Installed on, the vbseo_sitemap.php Page is loading m immediately until [SECTION START] showthread [2,423.1Kb mem used] [0s (+0)].

The Browser says "ready" and nothing happen, also when i wait for a while.


Thomas

[dieselpowered]

xtremeoff-road,

vB scheduler is executed in the moment when you forums are accessed only.

I.e., the task that is being setup to run at 2AM will be executed with the first hit on forum AFTER 2AM. And in case when forum are not active in the night hours ;), it is possible that this "nearest" hit was at 5:47AM :)

Hi there, alright can you explain this for me :)

Task is setup to run at 2am, now I understand that it will run after the first visit after 2am, however, this morning it ran at 2:17am and 3:33am. Why would it run twice?

TYIA!

[lexx27]

I cant find htaccess anywhere? I only found accesslog. What should i Do???

[ConqSoft]

Create the .htaccess if you don't already have one.

[Brandon Sheley]

how is this running now ? it's been updated since i last looked into it, if its running good I may add it now :)

[funinthesun]

How many .htaccess files are you supposed to have on your server because I have two at the moment? :confused:

[lexx27]

Create the .htaccess if you don't already have one.Thanks for the quick reply, How can i create one?

[ConqSoft]

Any text editor will do.

[ConqSoft]

How many .htaccess files are you supposed to have on your server because I have two at the moment? :confused:
As many as you want. Typically the settings in an .htaccess file will affect the current directory, and any sub-directories under that.