vb.org Archive - Administrative and Maintenance Tools - vBSEO Google/Yahoo Sitemap Generator

vb.org Archive (https://vborg.vbsupport.ru/index.php)

- vBulletin 3.6 Add-ons (https://vborg.vbsupport.ru/forumdisplay.php?f=194)

- - Administrative and Maintenance Tools - vBSEO Google/Yahoo Sitemap Generator (https://vborg.vbsupport.ru/showthread.php?t=144730)

vBSEO Google/Yahoo Sitemap Generator

vBSEO Google/Yahoo Sitemap Generator - vBulletin 3.6.x
Download vB 3.8.x Compatible Version Here
Download vB 3.7.x Compatible Version Here
Download vB 3.5.x Compatible Version Here
Download vB 3.0.x Compatible Version Here

Note: Version 2.5 replaces all previous versions of the vBSEO Google/Yahoo Sitemap Generator, and now includes support for all the new URL types in vBulletin 3.8.x.

Overview
============================

Providing Google, Yahoo, Ask sitemaps is an essential step towards improving your forums.

The "vBSEO Google Sitemaps" plugin provides a solution that allows your forum to be indexed by the Google (and also Yahoo and Ask) search engines faster, more completely, more effectively, and with less bandwidth consumption.

The ultimate goal is to help you achieve more web traffic for your forum.

Quote:

Originally Posted by Google's Description of GSM

https://services.google.com/inquiry/publishertools?hl=en_US
Google Sitemaps is an easy way for you to help improve your site?s representation in the Google index. It's a collaborative crawling system that enables you to communicate directly with Google. You get a smarter crawl because you can provide Google with specific information about all your web pages, such as when a page was last modified or how frequently it changes.

Note: This plugin is fully compliant with vBSEO 3.x version. The current version is vBSEO 3.2. However, if you are running vBSEO, please upgrade to vBSEO 3.2 or greater before installing.

Compatibility
============================

Fully compatible with:

vBulletin 3.0.x, 3.5.x, 3.6.x, 3.7.x and 3.8.x
vBulletin Blogs 1.0.x and 2.0.x *Optional
vBSEO 2.x, 3.x *Optional

What does it do?

============================

Auto-generates a Google XML sitemap for all of your specified forum URL types (including vBulletin Blog URLs).
Auto-generates a Yahoo text sitemap for all of your specified forum URL types.
Auto-notifies Google when a new sitemap is generated.
Automatically sends you a summary of the sitemap generation via email each time it is created.
Includes only publicly accessible forums and threads.
Allows Google/Yahoo to find all of your forum URLs without having to spider the forum to find the links.
Allows Google/Yahoo to find your forum URLs without having to account for query string and/or session ID information.
Allows Google to give precedence to crawling your higher priority forum pages.
Allows Google to give precedence to crawling your forum pages that change more frequently.
Allows you to conserve bandwidth by more efficiently facilitating the crawling processes for GoogleBot and Yahoo Slurp.
Is 100% compatible with the static CRUs (Content Relevant URLs) used by vBSEO-enabled forums.

How does it work?
============================

Whenever it is scheduled or invoked via the URL, this plugin will generate both the Google XML formatted and the Yahoo text formatted sitemaps. If you selected "Yes" to the Google auto-notification setting, Google will be notified each time the sitemap is generated. The Yahoo sitemap must be manually submitted to http://submit.search.yahoo.com/free/request/.

Google Sitemap files are gzipped
Forum and thread pages are listed with pagination (i.e. all pages for each forums/thread are included in the sitemap)
Maximum Priority is set for Sticky threads.
Optimization for sitemap generation on large forums.

Automated Reporting Tool
============================

The vBSEO Sitemap includes a report tool, allowing you to track your progress. To access your reports enter the following URL:

http://www.example.com/forums/vbseo_sitemap/

NOTE: Replace "http://www.example.com/forums/" with the full URL to your vB forum root.

You will be required to login by providing your "Sitemap Interface Access Password" from your vBSEO Sitemap settings in:

vBulletin Admin CP (for 3.5.x/3.6.x/3.7.x/3.8.x users) OR
vbseo_sitemap.php configuration file (for 3.0.x users) located in the vbseo_sitemap directory in your forum root.

Once you successfully login, you will be provided with a list of 'Useful Links'. Here are the 4 main links:

Show Reports List
The 'Show Reports List' link will display a report of each time your vBSEO Sitemap generator executed, including the (1) date, (2) run time, (3) total URLs included, and (4) and change in # of URLs included from the last generation.

Each vBSEO Sitemap generation record will include a (1) "View details" and (2) "Remove record" link. The "View Details" link shows more detailed information about the sitemap generated. The "Remove record" will permanently delete the record from your reports.

Show Sitemap Downloads Log
The 'Show Sitemap Downloads Log' link will display a report of each time your vBSEO Sitemap was downloaded by either a search engine (GoogleBot or Yahoo) or by another user agent (i.e. Web browser, etc.).

The report includes the (1) date, (2) name of sitemap file downloaded, (3) Bot, (4) IP address of the downloader, and the (5) User-agent.

Each vBSEO Sitemap download record will include a "Remove record" link which will permanently delete the record from your reports.

Run Sitemap Generator
The 'Run Sitemap Generator' link will automatically regenerate your Google and Yahoo sitemaps.

Your Forums Homepage
The 'Your Forums Homepage' link is a quick link back to your forum homepage.

Additional Links
Additional links to various other related SEO resources are also included.

Click "Install"
============================

Please click "Install" to show your support for this script. :)

Installation & Configuration for vB 3.5.x, 3.6.x, 3.7.x and 3.8.x as a Plugin
============================

Follow the installation/upgrade instructions provided in the docs/readme.html file.

Google Webmaster Accounts
============================

It is NOT required for you to have a Google Webmaster account to run the vBulletin Google Sitemaps plugin. If you decide to setup an account for testing purposes you can do so here:
http://www.google.com/webmasters/sitemaps/login?sourceid=gsm&subid=us-et-about2

Copyright & Licensing

============================

vBSEO Google Sitemaps plugin is copyright protected by Crawlability Inc.
You are free to download and install this plugin on any vBulletin forum for which you hold a valid vB license.
Unauthorized distribution of any code and/or documentation, whole or in part, included here is strictly prohibited.
In addition, the following copyright notice must be maintained.

vBSEO(TM) ? 2005-2009 Crawlability, Inc.

Revision History
============================

02/22/2009 - Version 2.5 Released

NEW FEATURE: Blog tags URLs are included.
NEW FEATURE: Social Group Discussion URLs are included.
NEW FEATURE: Smart Priority applied for the following URL types

Show Post
Member Profiles
Forum Display
Poll Results
Blog Entries
Member Profile Albums
Social Groups
Social Groups Discussions
Social Group Pictures
Tags
Blog Tags

UPDATE: Compatible with vBulletin 3.8.x. Includes the following updated settings:

Priority Range - Show Post
Priority Range - Member Profiles
Priority Range - Forum Display
Priority Range - Poll Results
Priority Range - Show Thread
Priority Range - Blog Entries
Priority Range - Member Profile Albums
Priority Range - Social Groups
Priority Range - Social Group Pictures
Priority Range - Tags

Fix: Social Group Discussion database error is fixed.

Upgrade Instructions
============================

(1) Follow the installation/upgrade instructions provided in the docs/readme.html file.

(2) For versions of vBulletin 3.6.x only: Open "Schedule Manager" in the vBulletin Admin Control Panel (admincp); Remove existing scheduled task for Sitemap Generator if you have one.
Note: The new task will be automatically setup when you import the XML product file.

Other vBSEO Plugins

============================

vBSEO Affiliate Program
============================

We welcome you to join the vBSEO Affiliate Program.

Wonderful.....I was waiting for this for a long time... Now i can happly upload my vbSEO to 3.0 Gold. Cheers to the vbSEO team.

Nice mod.

Thanks for upgrading.

Yeah now i will try to install this great tool. Also installed vbseo 3

Thanks all for your support :) You make us want to work harder!!

Cooooooooooooooool :D:D:D. Gonna upgrade right now. Thanks a lot Juan.

Oh my god! I can't believe this already. You don't know how much I've been waiting for the updates on vBSEO and Sitemap Generator. Thank you very much for all the hard work and support, Joey. I know it's you, by the way. :D

Upgraded, will generate a new sitemaps now :D

Quote:

Originally Posted by Snake (Post 1226542)

... Joey. (I know it's you, by the way) :D

huh?

GREAT!!!!Thanks a lot!!

Marco

Thank you.

Do I really need to edit my .htaccess? What if I don't, will it still work?

Upgrade in progress.

Quote:

Originally Posted by vBSEO (Post 1226547)

huh?

LMAO! Whoops sorry, my bad. I thought you were Joey from the vBSEO forums. Sorry once again, Juan. xD

Ok what URL do I use to add the sitemap on Google's webmasters tools site? Guys?

Is this it?

http://www.site.com/sitemap_index.xml.gz

cool, been waiting for a new version :).
This one will go well with my VBseo.

^^ thanks, this one is updated nicely, heaps of new features.

great ... ;)
vBSEO :up:

Thanks

Included in the 1.6 -> 2.0 upgrade instructions above, but not in the zip file

Quote:

(2) For versions of vBulletin 3.6.x only: Open "Schedule Manager" in the vBulletin Admin Control Panel (admincp); Remove existing scheduled task for Sitemap Generator if you have one.
Note: The new task will be automatically setup when you import the XML product file.

I ran 1.6 from cron, but when I saw these instructions I found vbseo_sitemap_task in vB's Scheduled Tasks. Was this put there by the new xml product or do I remove it?

Thanks for the great upgrade.

Bob

Quote:

Originally Posted by firstrebel (Post 1226752)

Included in the 1.6 -> 2.0 upgrade instructions above, but not in the zip file

I ran 1.6 from cron, but when I saw these instructions I found vbseo_sitemap_task in vB's Scheduled Tasks. Was this put there by the new xml product or do I remove it?

Thanks for the great upgrade.

Bob

When you upgrade, it will add the task automatically. If you already have one in there, just remove it once you upgrade.

Updated without a hitch, i think :)

Was the admin panel sub section supposed to be *[vbseo]* or did i not have phrase imported ?

Anyway i've run up the sitemap and it appears to work perfectly and now, at long last, my yahoo plain txt map works, woohooo :) Many many thanks.

Quote:

Originally Posted by sportsoutlaw (Post 1226756)

When you upgrade, it will add the task automatically. If you already have one in there, just remove it once you upgrade.

Oh so i'm not supposed to have a scheduled task listed now ? How would it know what time to run ?

Ah i see it

vbseo_sitemap_task

Scheduled for the same time. I'll delete that and run the one i had. I had updated the link prior to reading this :)

Quote:

Originally Posted by sportsoutlaw (Post 1226756)

When you upgrade, it will add the task automatically. If you already have one in there, just remove it once you upgrade.

Then the one there now must be the one vbseo 2.0 put there.

Bob

Quote:

Originally Posted by firstrebel (Post 1226775)

Then the one there now must be the one vbseo 2.0 put there.

Bob

Yes i had two, one from the upgrade and one from the older version. Deleted my old one in the end in favour of the newly imported one :)

Quote:

Originally Posted by dizzy100 (Post 1226761)

Was the admin panel sub section supposed to be *[vbseo]* or did i not have phrase imported ?

refresh the admin page after you upgrade the sitemap and those should change to regular links.

Quote:

Originally Posted by firstrebel (Post 1226775)

Then the one there now must be the one vbseo 2.0 put there.

Bob

Right. 2.0 will put one there automatically.

If anybody already had one there previously and ends up with two, just delete one of them. I might not have been clear on that when I first posted.

Quote:

Originally Posted by Dream (Post 1226594)

Ok what URL do I use to add the sitemap on Google's webmasters tools site? Guys?

Is this it?

http://www.site.com/sitemap_index.xml.gz

Yes.

Quote:

Originally Posted by sportsoutlaw (Post 1226786)

refresh the admin page after you upgrade the sitemap and those should change to regular links.

They have apart from the main category heading

Still shows *[vbseo]* but thats no biggy really. It all works :)

Quote:

Originally Posted by dizzy100 (Post 1226790)

They have apart from the main category heading

Still shows *[vbseo]* but thats no biggy really. It all works :)

If you don't have vBSEO installed, that might be why.

WOW, probably one of the best upgrades I've ever made. My prior version required so much fixing and tweaking to get it working with my vba cmps. This version works right out of the box without a bunch of fuss. Combined with my vba and vbseo I can now concentrate on enjoying my forum.

One feature I really like is the ability to designate where the sitemap should be located. My sitemap has always been created in the /forum directory and listed the path as such in the xml file, despite all my redirect efforts. All I had to do was type in my root domain and now the <loc> is listed as http://bike-talk.com/sitemap_index.xml.gz instead of http://bike-talk.com/forum/sitemap_index.xml.gz

Thanks guys, great job!

Hi Thanks alooot for release the new version :)

i have 2 question :

1 - my forum install in " Root/forum/ " so i used " www.mysitename./forum/sitemap... " also Root directory always redirected to Root/forum ! so now i can see the one of the Updates in new version is this :

Quote:

NEW FEATURE: 'Sitemap Files URL' option allows you to specify a non-default URL to use for your sitemap files location. Default is your default vBulletin URL. This is useful when your vBulletin installation is located in a sub-folder, instead of the root.

what does it mean exactly ? and now what shall i do for make the result better or ...

sorry i really dont get the point . plz explain it for me .

....

Also i dunno why never i have Notify = YES for Yahoo ... it always Shows No !
where i missed ??

---

Thanks again for upgrade :) keep up ur great job ...

you need to fix the cpnav_vbseo_sitemap.xml in there you will see <navgroup phrase="vbseo" displayorder="3"> it should be <navgroup phrase="vbseo_vbseo" displayorder="3"> if not it will show the incorrect phrase ( *[vbseo]* ) in admincp.

in the control panel it ask us for the Yahoo authentification code .. and mention a link to register in it ..
is this a must ?

Quote:

Originally Posted by spipo (Post 1226970)

in the control panel it ask us for the Yahoo authentification code .. and mention a link to register in it ..
is this a must ?

I believe you need that in order for Yahoo to accept an automated notification... though I could be wrong. I followed the link in the CP to Yahoo where I created an account for an API and just named my site name as the application. It generated this long code that I pasted back into the CP. Not sure if I did that right but now my report shows "Yes" for notifying Yahoo when the last sitemap was generated.

Mecho: I set mine to http://mydomain.com (use your actual root domain name) and it changed my sitemap to no longer read that its <LOC> to be in the /forum directory. If I leave it blank then the location seems to default to my forum directory. See example of my sitemap index below. Personally I think this (root) should be the prefered location if you have a homepage like vBa CMPS. Otherwise you are telling Google to crawl starting at your forum directory.
Here is what my sitemap index now looks like:

Code:

<sitemapindex xsi:schemaLocation="             http://www.sitemaps.org/schemas/sitemap/0.9             http://www.sitemaps.org/schemas/sitemap/09/siteindex.xsd">

−

        <sitemap>

<loc>http://bike-talk.com/sitemap_1.xml.gz</loc>

<lastmod>2007-04-13T10:23:19+00:00</lastmod>

</sitemap>

</sitemapindex>

Quote:

Originally Posted by kenfuzed (Post 1226984)

Code:

<sitemapindex xsi:schemaLocation="             http://www.sitemaps.org/schemas/sitemap/0.9             http://www.sitemaps.org/schemas/sitemap/09/siteindex.xsd">

−

        <sitemap>

<loc>http://bike-talk.com/sitemap_1.xml.gz</loc>

<lastmod>2007-04-13T10:23:19+00:00</lastmod>

</sitemap>

</sitemapindex>

it give me 4 choices ?

BBAuth for Single Sign On - No user data can be accessed
BBAuth with Read access for Yahoo! Photos
BBAuth with Read/Write access for Yahoo! Photos
BBAuth with Read/Write access for Yahoo! Mail

what should i select ?

Quote:

Originally Posted by spipo (Post 1227017)

Just use generic.

Quote:

Originally Posted by DementedMindz (Post 1226967)

Thank you that was driving me crazy.

upgrading right now :D

Phrase Groups Available:

X vBulletin 3.8.12 by vBS Debug Information
Page Generation 0.03609 seconds Memory Usage 1,880KB Queries Executed 10 (?)
More Information
Template Usage: (1)ad_footer_end (1)ad_footer_start (1)ad_header_end (1)ad_header_logo (1)ad_navbar_below (2)bbcode_code_printable (18)bbcode_quote_printable (1)footer (1)gobutton (1)header (1)headinclude (6)option (1)pagenav (1)pagenav_curpage (2)pagenav_pagelink (1)pagenav_pagelinkrel (1)post_thanks_navbar_search (1)printthread (40)printthreadbit (1)spacer_close (1)spacer_open Phrase Groups Available: global postbit showthread	Included Files: ./printthread.php ./global.php ./includes/init.php ./includes/class_core.php ./includes/config.php ./includes/functions.php ./includes/class_hook.php ./includes/modsystem_functions.php ./includes/class_bbcode_alt.php ./includes/class_bbcode.php ./includes/functions_bigthree.php Hooks Called: init_startup init_startup_session_setup_start init_startup_session_setup_complete cache_permissions fetch_threadinfo_query fetch_threadinfo fetch_foruminfo style_fetch cache_templates global_start parse_templates global_setup_complete printthread_start pagenav_page pagenav_complete bbcode_fetch_tags bbcode_create bbcode_parse_start bbcode_parse_complete_precache bbcode_parse_complete printthread_post printthread_complete
Messages: