PDA

View Full Version : Administrative and Maintenance Tools - vBSEO Google/Yahoo Sitemap Generator


Pages : [1] 2 3 4 5

vBSEO
04-12-2007, 10:00 PM
vBSEO Google/Yahoo Sitemap Generator - vBulletin 3.6.x
Download vB 3.8.x Compatible Version Here (https://vborg.vbsupport.ru/showthread.php?t=206169)
Download vB 3.7.x Compatible Version Here (https://vborg.vbsupport.ru/showthread.php?t=184573)
Download vB 3.5.x Compatible Version Here (https://vborg.vbsupport.ru/showthread.php?t=100435)
Download vB 3.0.x Compatible Version Here (https://vborg.vbsupport.ru/showthread.php?t=144732)


Note: Version 2.5 replaces all previous versions of the vBSEO Google/Yahoo Sitemap Generator, and now includes support for all the new URL types in vBulletin 3.8.x.

Overview
============================

Providing Google, Yahoo, Ask sitemaps is an essential step towards improving your forums.

The "vBSEO Google Sitemaps" plugin provides a solution that allows your forum to be indexed by the Google (http://www.google.com/) (and also Yahoo (http://www.yahoo.com/) and Ask (http://www.ask.com/)) search engines faster, more completely, more effectively, and with less bandwidth consumption.

The ultimate goal is to help you achieve more web traffic for your forum.

https://services.google.com/inquiry/publishertools?hl=en_US (https://services.google.com/inquiry/publishertools?hl=en_US)
Google Sitemaps is an easy way for you to help improve your site?s representation in the Google index. It's a collaborative crawling system that enables you to communicate directly with Google. You get a smarter crawl because you can provide Google with specific information about all your web pages, such as when a page was last modified or how frequently it changes.


Note: This plugin is fully compliant with vBSEO 3.x version. The current version is vBSEO 3.2 (http://www.vbseo.com/f5/vbseo-3-2-0-gold-released-24675/). However, if you are running vBSEO, please upgrade to vBSEO 3.2 or greater before installing.

Compatibility
============================


Fully compatible with:
vBulletin 3.0.x, 3.5.x, 3.6.x, 3.7.x and 3.8.x
vBulletin Blogs 1.0.x and 2.0.x *Optional
vBSEO 2.x, 3.x *OptionalWhat does it do?

============================
Auto-generates a Google XML sitemap for all of your specified forum URL types (including vBulletin Blog URLs).
Auto-generates a Yahoo text sitemap for all of your specified forum URL types.
Auto-notifies Google when a new sitemap is generated.
Automatically sends you a summary of the sitemap generation via email each time it is created.
Includes only publicly accessible forums and threads.
Allows Google/Yahoo to find all of your forum URLs without having to spider the forum to find the links.
Allows Google/Yahoo to find your forum URLs without having to account for query string and/or session ID information.
Allows Google to give precedence to crawling your higher priority forum pages.
Allows Google to give precedence to crawling your forum pages that change more frequently.
Allows you to conserve bandwidth by more efficiently facilitating the crawling processes for GoogleBot and Yahoo Slurp.
Is 100% compatible with the static CRUs (Content Relevant URLs) used by vBSEO (http://www.vbseo.com/)-enabled forums.How does it work?
============================

Whenever it is scheduled or invoked via the URL, this plugin will generate both the Google XML formatted and the Yahoo text formatted sitemaps. If you selected "Yes" to the Google auto-notification setting, Google will be notified each time the sitemap is generated. The Yahoo sitemap must be manually submitted to http://submit.search.yahoo.com/free/request/ (http://submit.search.yahoo.com/free/request/).
Google Sitemap files are gzipped
Forum and thread pages are listed with pagination (i.e. all pages for each forums/thread are included in the sitemap)
Maximum Priority is set for Sticky threads.
Optimization for sitemap generation on large forums.Automated Reporting Tool
============================

The vBSEO Sitemap includes a report tool, allowing you to track your progress. To access your reports enter the following URL:

http://www.example.com/forums/vbseo_sitemap/ (http://www.example.com/forums/vbseo_sitemap/)

NOTE: Replace "http://www.example.com/forums/ (http://www.example.com/forums/)" with the full URL to your vB forum root.


You will be required to login by providing your "Sitemap Interface Access Password" from your vBSEO Sitemap settings in:
vBulletin Admin CP (for 3.5.x/3.6.x/3.7.x/3.8.x users) OR
vbseo_sitemap.php configuration file (for 3.0.x users) located in the vbseo_sitemap directory in your forum root.Once you successfully login, you will be provided with a list of 'Useful Links'. Here are the 4 main links:

Show Reports List
The 'Show Reports List' link will display a report of each time your vBSEO Sitemap generator executed, including the (1) date, (2) run time, (3) total URLs included, and (4) and change in # of URLs included from the last generation.

Each vBSEO Sitemap generation record will include a (1) "View details" and (2) "Remove record" link. The "View Details" link shows more detailed information about the sitemap generated. The "Remove record" will permanently delete the record from your reports.

Show Sitemap Downloads Log
The 'Show Sitemap Downloads Log' link will display a report of each time your vBSEO Sitemap was downloaded by either a search engine (GoogleBot or Yahoo) or by another user agent (i.e. Web browser, etc.).

The report includes the (1) date, (2) name of sitemap file downloaded, (3) Bot, (4) IP address of the downloader, and the (5) User-agent.

Each vBSEO Sitemap download record will include a "Remove record" link which will permanently delete the record from your reports.

Run Sitemap Generator
The 'Run Sitemap Generator' link will automatically regenerate your Google and Yahoo sitemaps.

Your Forums Homepage
The 'Your Forums Homepage' link is a quick link back to your forum homepage.

Additional Links
Additional links to various other related SEO resources are also included.


Click "Install"
============================

Please click "Install" to show your support for this script. :)


Installation & Configuration for vB 3.5.x, 3.6.x, 3.7.x and 3.8.x as a Plugin
============================

Follow the installation/upgrade instructions provided in the docs/readme.html file.


Google Webmaster Accounts
============================

It is NOT required for you to have a Google Webmaster account to run the vBulletin Google Sitemaps plugin. If you decide to setup an account for testing purposes you can do so here:
http://www.google.com/webmasters/sitemaps/login?sourceid=gsm&subid=us-et-about2 (http://www.google.com/webmasters/sitemaps/login?sourceid=gsm&subid=us-et-about2)


Copyright & Licensing

============================
vBSEO Google Sitemaps plugin is copyright protected by Crawlability Inc.
You are free to download and install this plugin on any vBulletin forum for which you hold a valid vB license.
Unauthorized distribution of any code and/or documentation, whole or in part, included here is strictly prohibited.
In addition, the following copyright notice must be maintained.vBSEO(TM) ? 2005-2009 Crawlability, Inc.


Revision History
============================

02/22/2009 - Version 2.5 Released

NEW FEATURE: Blog tags URLs are included.
NEW FEATURE: Social Group Discussion URLs are included.
NEW FEATURE: Smart Priority applied for the following URL types
Show Post
Member Profiles
Forum Display
Poll Results
Blog Entries
Member Profile Albums
Social Groups
Social Groups Discussions
Social Group Pictures
Tags
Blog TagsUPDATE: Compatible with vBulletin 3.8.x. Includes the following updated settings:
Priority Range - Show Post
Priority Range - Member Profiles
Priority Range - Forum Display
Priority Range - Poll Results
Priority Range - Show Thread
Priority Range - Blog Entries
Priority Range - Member Profile Albums
Priority Range - Social Groups
Priority Range - Social Group Pictures
Priority Range - Tags Fix: Social Group Discussion database error is fixed.

Upgrade Instructions
============================

(1) Follow the installation/upgrade instructions provided in the docs/readme.html file.

(2) For versions of vBulletin 3.6.x only: Open "Schedule Manager" in the vBulletin Admin Control Panel (admincp); Remove existing scheduled task for Sitemap Generator if you have one.
Note: The new task will be automatically setup when you import the XML product file.

Other vBSEO Plugins

============================
vBSEO - vBulletin Search Engine Optimization
(http://www.vbseo.com/)
vBSEO Conditional Signatures for vBulletin (https://vborg.vbsupport.ru/showthread.php?t=97685)vBSEO Affiliate Program
============================

We welcome you to join the vBSEO Affiliate Program (http://www.vbseo.com/aff/).

UnixGeek
04-13-2007, 09:28 AM
Wonderful.....I was waiting for this for a long time... Now i can happly upload my vbSEO to 3.0 Gold. Cheers to the vbSEO team.

blockbusted
04-13-2007, 09:32 AM
Nice mod.

Thanks for upgrading.

KoC
04-13-2007, 09:32 AM
Yeah now i will try to install this great tool. Also installed vbseo 3

vBSEO
04-13-2007, 09:40 AM
Thanks all for your support :) You make us want to work harder!!

Mudvayne
04-13-2007, 09:44 AM
Cooooooooooooooool :D:D:D. Gonna upgrade right now. Thanks a lot Juan.

Snake
04-13-2007, 09:51 AM
Oh my god! I can't believe this already. You don't know how much I've been waiting for the updates on vBSEO and Sitemap Generator. Thank you very much for all the hard work and support, Joey. I know it's you, by the way. :D

THE X FILES
04-13-2007, 09:55 AM
Upgraded, will generate a new sitemaps now :D

vBSEO
04-13-2007, 09:58 AM
... Joey. (I know it's you, by the way) :Dhuh?

principino1984
04-13-2007, 10:10 AM
GREAT!!!!Thanks a lot!!

Marco

Dream
04-13-2007, 10:24 AM
Thank you.

Do I really need to edit my .htaccess? What if I don't, will it still work?

maroceve
04-13-2007, 10:27 AM
Upgrade in progress.

Snake
04-13-2007, 10:42 AM
huh?
LMAO! Whoops sorry, my bad. I thought you were Joey from the vBSEO forums. Sorry once again, Juan. xD

Dream
04-13-2007, 10:57 AM
Ok what URL do I use to add the sitemap on Google's webmasters tools site? Guys?

Is this it?

http://www.site.com/sitemap_index.xml.gz

imranbaig
04-13-2007, 11:38 AM
cool, been waiting for a new version :).
This one will go well with my VBseo.

Hornstar
04-13-2007, 12:00 PM
^^ thanks, this one is updated nicely, heaps of new features.

a1exus
04-13-2007, 02:08 PM
awesome!

bela-meaad
04-13-2007, 02:16 PM
great ... ;)
vBSEO :up:

Thanks

Kaleem
04-13-2007, 02:44 PM
Thank you :)

firstrebel
04-13-2007, 02:46 PM
Included in the 1.6 -> 2.0 upgrade instructions above, but not in the zip file
(2) For versions of vBulletin 3.6.x only: Open "Schedule Manager" in the vBulletin Admin Control Panel (admincp); Remove existing scheduled task for Sitemap Generator if you have one.
Note: The new task will be automatically setup when you import the XML product file.
I ran 1.6 from cron, but when I saw these instructions I found vbseo_sitemap_task in vB's Scheduled Tasks. Was this put there by the new xml product or do I remove it?

Thanks for the great upgrade.

Bob

sportsoutlaw
04-13-2007, 02:48 PM
Included in the 1.6 -> 2.0 upgrade instructions above, but not in the zip file

I ran 1.6 from cron, but when I saw these instructions I found vbseo_sitemap_task in vB's Scheduled Tasks. Was this put there by the new xml product or do I remove it?

Thanks for the great upgrade.

Bob

When you upgrade, it will add the task automatically. If you already have one in there, just remove it once you upgrade.

dizzy100
04-13-2007, 02:55 PM
Updated without a hitch, i think :)

Was the admin panel sub section supposed to be *[vbseo]* or did i not have phrase imported ?

Anyway i've run up the sitemap and it appears to work perfectly and now, at long last, my yahoo plain txt map works, woohooo :) Many many thanks.

dizzy100
04-13-2007, 02:56 PM
When you upgrade, it will add the task automatically. If you already have one in there, just remove it once you upgrade.

Oh so i'm not supposed to have a scheduled task listed now ? How would it know what time to run ?

Ah i see it

vbseo_sitemap_task

Scheduled for the same time. I'll delete that and run the one i had. I had updated the link prior to reading this :)

firstrebel
04-13-2007, 03:07 PM
When you upgrade, it will add the task automatically. If you already have one in there, just remove it once you upgrade.

Then the one there now must be the one vbseo 2.0 put there.

Bob

dizzy100
04-13-2007, 03:13 PM
Then the one there now must be the one vbseo 2.0 put there.

Bob

Yes i had two, one from the upgrade and one from the older version. Deleted my old one in the end in favour of the newly imported one :)

sportsoutlaw
04-13-2007, 03:20 PM
Was the admin panel sub section supposed to be *[vbseo]* or did i not have phrase imported ?


refresh the admin page after you upgrade the sitemap and those should change to regular links.

sportsoutlaw
04-13-2007, 03:22 PM
Then the one there now must be the one vbseo 2.0 put there.

Bob

Right. 2.0 will put one there automatically.

If anybody already had one there previously and ends up with two, just delete one of them. I might not have been clear on that when I first posted.

sportsoutlaw
04-13-2007, 03:23 PM
Ok what URL do I use to add the sitemap on Google's webmasters tools site? Guys?

Is this it?

http://www.site.com/sitemap_index.xml.gz

Yes.

dizzy100
04-13-2007, 03:23 PM
refresh the admin page after you upgrade the sitemap and those should change to regular links.

They have apart from the main category heading

Still shows *[vbseo]* but thats no biggy really. It all works :)

sportsoutlaw
04-13-2007, 03:48 PM
They have apart from the main category heading

Still shows *[vbseo]* but thats no biggy really. It all works :)

If you don't have vBSEO installed, that might be why.

kenfuzed
04-13-2007, 03:52 PM
WOW, probably one of the best upgrades I've ever made. My prior version required so much fixing and tweaking to get it working with my vba cmps. This version works right out of the box without a bunch of fuss. Combined with my vba and vbseo (http://www.vbseo.com/590/) I can now concentrate on enjoying my forum.

One feature I really like is the ability to designate where the sitemap should be located. My sitemap has always been created in the /forum directory and listed the path as such in the xml file, despite all my redirect efforts. All I had to do was type in my root domain and now the <loc> is listed as http://bike-talk.com/sitemap_index.xml.gz instead of http://bike-talk.com/forum/sitemap_index.xml.gz

Thanks guys, great job!

briansol
04-13-2007, 03:58 PM
:up: great release!

Mecho
04-13-2007, 06:24 PM
Hi Thanks alooot for release the new version :)

i have 2 question :

1 - my forum install in " Root/forum/ " so i used " www.mysitename./forum/sitemap... " also Root directory always redirected to Root/forum ! so now i can see the one of the Updates in new version is this :
NEW FEATURE: 'Sitemap Files URL' option allows you to specify a non-default URL to use for your sitemap files location. Default is your default vBulletin URL. This is useful when your vBulletin installation is located in a sub-folder, instead of the root.

what does it mean exactly ? and now what shall i do for make the result better or ...

sorry i really dont get the point . plz explain it for me .

....

Also i dunno why never i have Notify = YES for Yahoo ... it always Shows No !
where i missed ??

---

Thanks again for upgrade :) keep up ur great job ...

DementedMindz
04-13-2007, 07:40 PM
you need to fix the cpnav_vbseo_sitemap.xml in there you will see <navgroup phrase="vbseo" displayorder="3"> it should be <navgroup phrase="vbseo_vbseo" displayorder="3"> if not it will show the incorrect phrase ( *[vbseo]* ) in admincp.

spipo
04-13-2007, 07:46 PM
in the control panel it ask us for the Yahoo authentification code .. and mention a link to register in it ..
is this a must ?

kenfuzed
04-13-2007, 08:17 PM
in the control panel it ask us for the Yahoo authentification code .. and mention a link to register in it ..
is this a must ?I believe you need that in order for Yahoo to accept an automated notification... though I could be wrong. I followed the link in the CP to Yahoo where I created an account for an API and just named my site name as the application. It generated this long code that I pasted back into the CP. Not sure if I did that right but now my report shows "Yes" for notifying Yahoo when the last sitemap was generated.

Mecho: I set mine to http://mydomain.com (use your actual root domain name) and it changed my sitemap to no longer read that its <LOC> to be in the /forum directory. If I leave it blank then the location seems to default to my forum directory. See example of my sitemap index below. Personally I think this (root) should be the prefered location if you have a homepage like vBa CMPS. Otherwise you are telling Google to crawl starting at your forum directory.
Here is what my sitemap index now looks like:
<sitemapindex xsi:schemaLocation=" http://www.sitemaps.org/schemas/sitemap/0.9 http://www.sitemaps.org/schemas/sitemap/09/siteindex.xsd">

<sitemap>
<loc>http://bike-talk.com/sitemap_1.xml.gz</loc>
<lastmod>2007-04-13T10:23:19+00:00</lastmod>
</sitemap>
</sitemapindex>

spipo
04-13-2007, 09:02 PM
I believe you need that in order for Yahoo to accept an automated notification... though I could be wrong. I followed the link in the CP to Yahoo where I created an account for an API and just named my site name as the application. It generated this long code that I pasted back into the CP. Not sure if I did that right but now my report shows "Yes" for notifying Yahoo when the last sitemap was generated.

Mecho: I set mine to http://mydomain.com (use your actual root domain name) and it changed my sitemap to no longer read that its <LOC> to be in the /forum directory. If I leave it blank then the location seems to default to my forum directory. See example of my sitemap index below. Personally I think this (root) should be the prefered location if you have a homepage like vBa CMPS. Otherwise you are telling Google to crawl starting at your forum directory.
Here is what my sitemap index now looks like:
<sitemapindex xsi:schemaLocation=" http://www.sitemaps.org/schemas/sitemap/0.9 http://www.sitemaps.org/schemas/sitemap/09/siteindex.xsd">

<sitemap>
<loc>http://bike-talk.com/sitemap_1.xml.gz</loc>
<lastmod>2007-04-13T10:23:19+00:00</lastmod>
</sitemap>
</sitemapindex>


it give me 4 choices ?


BBAuth for Single Sign On - No user data can be accessed
BBAuth with Read access for Yahoo! Photos
BBAuth with Read/Write access for Yahoo! Photos
BBAuth with Read/Write access for Yahoo! Mail

what should i select ?

rjmjr69
04-13-2007, 10:10 PM
it give me 4 choices ?


BBAuth for Single Sign On - No user data can be accessed
BBAuth with Read access for Yahoo! Photos
BBAuth with Read/Write access for Yahoo! Photos
BBAuth with Read/Write access for Yahoo! Mail

what should i select ?


Just use generic.

rjmjr69
04-13-2007, 10:14 PM
you need to fix the cpnav_vbseo_sitemap.xml in there you will see <navgroup phrase="vbseo" displayorder="3"> it should be <navgroup phrase="vbseo_vbseo" displayorder="3"> if not it will show the incorrect phrase ( *[vbseo]* ) in admincp.

Thank you that was driving me crazy.

Michael Biddle
04-13-2007, 11:46 PM
upgrading right now :D

DementedMindz
04-14-2007, 12:10 AM
Thank you that was driving me crazy.


no problem me too

ArAb4NoKiA
04-14-2007, 03:38 AM
Hello,

i have this errors :
Warning: fopen(/home/nokia/public_html/vb/vbseo_sitemap/data/downloads.dat) [function.fopen]: failed to open stream: Permission denied in /home/nokia/public_html/vb/vbseo_sitemap/vbseo_getsitemap.php on line 48

Warning: fwrite(): supplied argument is not a valid stream resource in /home/nokia/public_html/vb/vbseo_sitemap/vbseo_getsitemap.php on line 49

Warning: fclose(): supplied argument is not a valid stream resource in /home/nokia/public_html/vb/vbseo_sitemap/vbseo_getsitemap.php on line 50
‹������ŖOkƒ0ÆÏ+ô;H®ÃüQ»VQ{ Û©;+ƒÝJªÁ†Õ¤˜PeŸ~Yª[{켞DÞçý=>‡äë¡=gÑ©U¦(ªÒµTMÞ¶Ïá +Ëù,7Ҋ–Ÿ¤ªÅ0ŸþqRe t°ö”Ò÷=§Ö]CLupCƏ„âÝH³ÁÈy{aD)#ï/›W¿ ”ÊX®*ñ+62»,ßèŠ[ï|Z|qv‡¥? Sÿ[><˜]eä^ò£®Ê+JHžðŽï±–œ÷S*;†]Œ¸ùÌÉ·ÄK¹±+®KÃ2¤IȒ-2šdñâ‘ÒŒR7:Ž¸ƒ™•?gt?æÇÀü˜¿�æ ?ó—Àü0?æ3 m�ºt2èdÐ%È [A× ƒîAöExu+ñ¤ò©àf ��

why ?

THE X FILES
04-14-2007, 03:51 AM
Hello,

i have this errors :
Warning: fopen(/home/nokia/public_html/vb/vbseo_sitemap/data/downloads.dat) [function.fopen]: failed to open stream: Permission denied in /home/nokia/public_html/vb/vbseo_sitemap/vbseo_getsitemap.php on line 48

Warning: fwrite(): supplied argument is not a valid stream resource in /home/nokia/public_html/vb/vbseo_sitemap/vbseo_getsitemap.php on line 49

Warning: fclose(): supplied argument is not a valid stream resource in /home/nokia/public_html/vb/vbseo_sitemap/vbseo_getsitemap.php on line 50
?������ŖOk?0??+?;H???Q?VQ{۩;+??J???դ?Pe? ~Y?[{???D???=>?????=g??U??(?ҵTM?޶?? +??,7Ҋ?????0??qRe t?????=? ?]CLupCƏ???H???y{aD)#?/?W? ??X?*?+62?,???[?|Z|qv??? S?[><?]e?^????+JH????????S*;?]????ɷ?K??+?K?2?IȒ-?2?d???ҌR7:??????gt???????�??????0??3 m�?t2?d?%? [?A? ??A?Exu+??? ???f ��


why ?

Set permission 666 for downloads.dat file, this will solve it.

ArAb4NoKiA
04-14-2007, 04:00 AM
Thank You very much

dizzy100
04-14-2007, 07:07 AM
you need to fix the cpnav_vbseo_sitemap.xml in there you will see <navgroup phrase="vbseo" displayorder="3"> it should be <navgroup phrase="vbseo_vbseo" displayorder="3"> if not it will show the incorrect phrase ( *[vbseo]* ) in admincp.

Thanks mate, that did the trick. Minor but annoying little cosmetic bug :)

DementedMindz
04-14-2007, 07:18 AM
Thanks mate, that did the trick. Minor but annoying little cosmetic bug :)

no problem at all

projectego
04-14-2007, 07:55 AM
/me clicks install

firstrebel
04-14-2007, 10:01 AM
I have just moved our forum from volvoclub.org.uk/forum to volvoforums.org.uk. I have regenerated new sitemaps to reflect the new URL, but will all the forum threads be in the maps or just newer ones. I don't want the old URL to be in Google's index.

Bob

FIM
04-14-2007, 09:56 PM
Updated thanks :up:

KipLarson
04-15-2007, 03:03 AM
Sounds good. By the way, you should update your downloads section on vBseo.com to show this is out (it currently still shows 1.7 which I was about to install until I noticed this thread).

Will post back if I have trouble with the install. Thanks, I'm excited about vBseo! I just bought two licenses on Friday.

zand
04-15-2007, 05:40 AM
I just upgraded from version 1.7 to this and when I access the sitemap URL and tries to access the forums there, it just keeps showing the forumlist. Can someone help me figure out whats wrong? It was like this with version 1.7, but I never had time to figure it out. The sitemap can be seen here (http://symbian.no/sitemap). Thanks!

GrendelKhan{TSU
04-15-2007, 11:53 AM
indispensable. thanks!!

<< clicks install. :D

Yellow Slider
04-15-2007, 08:40 PM
INstalled.

Dear Coder, I need to ask for a modification in the Generator, what do i need to do , in order to exclude old theards from being added to the site maps, lets say that i want threads that their id is bigger then X to appear in the sitemaps, what do i need to do? (i have alot of content from 2005\2006 that I really don't want to be indexed in google..

Thanks alot, it's very important to me

Yellow Slider
04-16-2007, 04:56 PM
OK i have a MAJOR problem!
last week i have added to the Excluded Forums List , alot of trash forums that exits on my board, we have there somthing like 300,000 posts.

the forum total statics -
posts : 1,800,800~
theards : 180,000~
members :36,000~

this is my Report list
11 2007-04-04 05:00 909.23 s 1,573,346 +2,120 Yes No View details | Remove record
12 2007-04-05 05:00 554.56 s 1,568,376 -4,970 Yes No View details | Remove record
13 2007-04-06 05:00 606.44 s 1,571,920 +3,544 Yes No View details | Remove record
14 2007-04-07 05:00 891.27 s 1,574,456 +2,536 Yes No View details | Remove record
15 2007-04-08 01:22 505.14 s 1,541,179 -33,277 Yes No View details | Remove record
16 2007-04-08 05:00 539.48 s 1,540,127 -1,052 Yes No View details | Remove record
17 2007-04-09 05:02 57.11 s 296,293 -1,243,834 Yes No View details | Remove record
18 2007-04-10 05:00 61.85 s 296,783 +490 Yes No View details | Remove record
19 2007-04-11 05:00 72.39 s 297,324 +541 Yes No View details | Remove record
20 2007-04-12 05:00 68.71 s 297,842 - Yes No View details | Remove record
21 2007-04-13 05:00 53.63 s 298,400 +558 Yes No View details | Remove record
22 2007-04-14 05:00 59.94 s 298,818 +418 Yes No View details | Remove record
23 2007-04-15 05:00 61.75 s 299,273 +455 Yes No View details | Remove record
24 2007-04-16 05:00 81.00 s 298,307 -966 Yes No View details | Remove record

you can see that the total url has dropped down alot, more then it shuold had been..
also the new change had droped down too much, and we still have somthing like 2000-3000 posts a day, so i can see why wh have this huge decrease in the Reports List
ohh, i have also chose not to include Member Profile Pages and Show Post Pages .
but still -1,200,000~ urls are alot.. and i really think that its too much.
maybe i'm wrong correct me if i am, thanks.

Sean James
04-17-2007, 02:32 PM
Nice works VBSEO ;)

brvheart
04-17-2007, 03:31 PM
gladly installed, worked perfect thank you for this update :)


How can I exclude certain forum ID's like those private for staff etc?

iojam
04-17-2007, 07:42 PM
Yellow Slider, brvheart,

only the posts from subforums visible to guests are included in the sitemap.

Calibre_k
04-17-2007, 07:47 PM
Do i have to have vbseo installed to have this feature or will this work on its own?

rayw
04-18-2007, 09:35 AM
Installed and working very nicely. Thanks a lot :)

In google's webmaster tools, do you need to submit the sitemap manually, or is this what the mod is doing for you automatically? I can see the option in the AdminCP but I'm not 100% sure whether this is the same thing or not.

Cheers! :)

brvheart
04-18-2007, 11:22 AM
Yellow Slider, brvheart,

only the posts from subforums visible to guests are included in the sitemap.

thank you :)

dxguru
04-21-2007, 11:28 AM
Is this a problem or a glitch?

Upgraded to v2 and the emails I am getting saySummary:
============================
Forum Display: 0
Show Thread:
Show Post:
Member Profiles: 35880
Poll Results: 0
Archive: 1Am I reading this correctly that No threads or posts are being included in the sitemap? If so, why?

OziloZ
04-21-2007, 11:53 AM
Before this mod we had 20.000 indexed page.
After this awesome mod: 97.000 :)

dxguru
04-21-2007, 12:26 PM
Upgraded to v2 and the emails I am getting sayAm I reading this correctly that No threads or posts are being included in the sitemap? If so, why?
Re-read some of this thread and, if I understand it right, I either still have a problem or there is a bug with the script.

Our forum is setup so that guests can see the forums and the threads but must be logged in to read the posts. Therefore I would expect to see the sitemap generated with Forum and Thread URLs, but not post URLs.

BUT, I would not expect to see member profiles included because guests can't see them.

What I would like to see is the ability to generate the sitemap based on a specific users permissions.

bigwest
04-21-2007, 08:56 PM
My forum is now broken.....

I got to step C. in your install instructions but when I got to my admincp I get the error...

Fatal Error
Could not open /home3/mysite/public_html/forum/includes/xml/cpnav_vbulletin.xml

And now... even when I delete all the vbseo files I still get that error. I haven't even got to the stage where I install the plugin because I can't see my plugin manager any longer.

Any idea of what I should do?

bigwest
04-21-2007, 09:13 PM
For sake of clarity I have attached a screen grab of my error.

It's weird.... why would I still get this error even after deleting all the VBSEO files?

bigwest
04-21-2007, 11:00 PM
All fixed!!

Sorry!

oldengine
04-22-2007, 01:32 AM
This worked once, but now when running the site map generator, after a delay I get, "The page cannot be displayed" and "The page you are looking for is currently unavailable. The Web site might be experiencing technical difficulties, or you may need to adjust your browser settings"

It is as though it times out and goes into failure mode. This happens more often than not. In fact, I have only seen two runs to completion on my site.

Does this mean that I now have an incomplete site map presented to Google?

Any suggestions to correct this?

Looking in on Google:

View errors for: sitemap_2.xml.gz Errors
View errors for: sitemap_3.xml.gz Errors
View errors for: sitemap_4.xml.gz Errors
View errors for: sitemap_5.xml.gz Errors

I took the Max URLs in Sitemap Files to 20,000 rather than more and it ran OK this time.

Ideas?

tuanvic
04-22-2007, 07:46 AM
In fact, I have chagne the archive folder from for example

http://mysite.com/archive/index.php?t-123.html

to

http://mysite.com/my_new_archive/index.php/t-123.html


What should i do for including my new archive url in sitemap vbSEO ?

Thanks

tuanvic
04-22-2007, 08:08 AM
I've found, all you have to do is :
change all value "archive/index" by "your_new_path_archive/index.php" in "vbseo_sitemap_functions.php"

Ronak
04-22-2007, 04:34 PM
This thing deserves a Nomination for MOTM...as my indexed pages in Google increased from 4000 to 7000+ in few days :D

jketron
04-23-2007, 01:50 AM
Where is it that I can put the password? I looked here and did not see it

Go to your ADMIN CP > vBulletin Options > vBSEO Google/Yahoo Sitemap Generator.
Edit your settings as desired.
Important: Enter your vBSEO Sitemap Interface Access Password (this will prevent unauthorized access to your automated reports).

oldengine
04-25-2007, 12:46 PM
My site generates 14 zipped sitemap pages at the 20,000 setting.

Sitemap Generator History: 271,958 URLs

Yet my Google site: Results 1 - 10 of about 34,700 URLs

Last Google crawl:
sitemap_index.xml.gz Sitemap Index Web Apr 21, 2007 7 hours ago OK 272681

It appears that Google is ignoring 13 of the 14 zipped sitemap files?

Travlur
04-26-2007, 06:15 AM
I have 3.6.5 with vbseo gold. I set the password in cpadmin, go to /vbseo_sitemap/ enter password and it does nothing / rejects it I guess. What next?

MikeHolohan
04-26-2007, 04:48 PM
I just installed this yesterday and alrady I got I think 12 emails telling me that... vBSEO Google/Yahoo Sitemap Updated, is that normal or do i need to adjust some setting?

Mike.

T_Richardson
04-26-2007, 05:21 PM
I just installed vBseo from vbseo.com and I don't think it's sending the rewrite urls to google.
I set the option to use VBSEO, ran the task and looked in the "sitemap_1.xml.gz" file, and the urls are the same.

Any suggestions or is this normal?

iojam
04-28-2007, 11:35 PM
dxguru
Our forum is setup so that guests can see the forums and the threads but must be logged in to read the posts.
These links are not included in the sitemap.Our forum is setup so that guests can see the forums and the threads but must be logged in to read the posts. Therefore I would expect to see the sitemap generated with Forum and Thread URLs, but not post URLs.You can disable including member profile links in vBSEO SItemap Generator options.

jketron,

there is a "vBSEO Sitemap Interface Access Password" setting in the options list.


MikeHolohan,

make sure that you have "minutes" set to "0" in the scheduled task settings.

Travlur,

please open a support ticket at vbseo.com for troubleshooting.

T_Richardson

if you have "Include old URLs" option enabled, you will have *both* SEOed and original URLs included in sitemap.

T_Richardson
04-28-2007, 11:40 PM
Thank you for your support, I noticed after a few hours that it converted the urls to the site map. And I enabled the option for old URLs.

Thanks.

mrcrx
04-30-2007, 11:52 AM
I uploaded the upload folder instead of its contents and now it wont let me delete it from the server. How can I remove this so I can start over? Sorry for the silly question.

The error I get is 550 data. Directory not empty.

MikeHolohan
04-30-2007, 04:47 PM
MikeHolohan,

make sure that you have "minutes" set to "0" in the scheduled task settings.



Thanks...

Mike.

T_Richardson
05-01-2007, 07:38 PM
Is this the same that vBseo provides? - vBSEO Google/Yahoo Sitemap Generator v.2.0

Pitman
05-01-2007, 08:08 PM
I have 3.6.5 with vbseo gold. I set the password in cpadmin, go to /vbseo_sitemap/ enter password and it does nothing / rejects it I guess. What next?I have a similar problem, although I don't have vBSEO installed (other than this addon). I was able to login last night, but now, no matter what I try to change the password to, it doesn't accept it and keeps looping around wanting me to login. Other than that, it seems to be working ok.

Antivirus
05-03-2007, 04:27 PM
Very nice work vbseo, thank you for publicly releasing. One question however... Our site has a directory structure of ROOT/FORUM/ where there are a few custom scripts which reside in the root directory and need to be included in the files generated by the VBSEO Sitemap Generator script. I can tell it's something to do with the "Sitemap Files URL" setting in AdminCP however what exactly do I enter here? Can i simply enter http://www.example/com and it will now include all root files as well?

Please advise and thank you :)

adhari_com
05-05-2007, 05:44 PM
I'm having the same problem here too, I've installed correctly and generated the sitemaps. But I can't either access them anywhere, I dunno where should they appear or what to add them?

Do I have to have vBSEO installed?

Please advice.

da420
05-05-2007, 05:47 PM
Do I have to have vBSEO installed?


No.

Antivirus
05-05-2007, 08:34 PM
I solved my problem above. You need to use the .htaccess if on apache server and if on windows server need to make an httpd.ini file either of these will redirect url requests from root directory to the /data directory in installed files where sitemaps are generated

Terminatoronly
05-07-2007, 11:14 AM
i get Internal Server Error

how can i fix this?

iojam
05-07-2007, 02:14 PM
mrcrx,

you should remove all files from that folder then.

Pitman,

do you get "Login failed" message?

Terminatoronly,

try to add "RewriteBase /forum/" line in your .htaccess (modify it with your forums folder name).

newforum
05-07-2007, 04:54 PM
should we have vbseo 3.x to install this hack. Or can we install without vbseo.

newforum
05-07-2007, 04:57 PM
What to give in the google webmaster for sitemap. If i give this url is gives a error. And this file is not present in the root directory. Where is this file located should we create it.
http://www.einvestorsforum.com/sitemap.xml/sitemap_index.xml.gz

yayvb
05-07-2007, 10:18 PM
I run a social networking site with more than 50,000 members since August 2006. I run vBulletin as my forum software and I have vbseo. Is there any way for me to have vbseo not only create google/yahoo site maps, but also include all of the profiles of my members?

The member profile link would be something like this:
www.domain.com/view_profile.php?member_id=2500

Each person has a non dynamic link such as

www.domain.com/2500
or some people who have changed their name have it even better such as:
www.domain.com/Chris

So does anyone know of how I could edit this plugin to incorporate member profiles?

Chris

Antivirus
05-07-2007, 11:25 PM
So does anyone know of how I could edit this plugin to incorporate member profiles?

Isn't it just a setting in the mod's options to include member profiles in the sitemap?

djbaxter
05-09-2007, 01:00 PM
(2) For versions of vBulletin 3.6.x only: Open "Schedule Manager" in the vBulletin Admin Control Panel (admincp); Remove existing scheduled task for Sitemap Generator if you have one.

I missed this part. I now have two tasks listed for this add-on. The older one can be disabled but no longer has an option to delete.

How do I get rid of it?

Never mind: deleted it using phpMyAdmin.

Addendum: ^^^ which turned out to be a bad idea. I'm not sure why this task has no description but it seems to be required for compression of the sitemap files and perhaps other functions. Reinstalled to add it back in.

It would be nice if this had something to describe its prupose.

bagpiper
05-09-2007, 03:46 PM
Hello,

I have installed a new version of this mod into VB 3.6 and it appears to be working. The sitemap was generated and saved to the /data folder.

When I attempted to enter the url of the sitemap into google webmaster site (ie: http://www.myforums.com/sitemap_index.xml.gz) it states that the file can not be found.

I pasted a copy of the sitemap_index.xml.gz under the /forums directory to see if it works and it does.

Is there something I need to change in the .htaccess file ?

Thanks,

djbaxter
05-09-2007, 04:38 PM
Yes. See the instructions for the mod.

kontrabass
05-10-2007, 06:14 PM
Since installing this and sending Google a sitemap every day for the past month, my search result ranking (for specific terms like "bass guitar") have dropped. For the past 3+ years I've been in the top few results for 'bass guitar'. Now I'm not even on the first page anymore.

Am I out of line blaming this mod? My google PageRank has remained steady at 6/10... I'm sending Google a 4 million URL sitemap everyday - maybe it's too much data?

djbaxter
05-10-2007, 06:27 PM
Am I out of line blaming this mod?

Yes. All this add-on does is create a sitemap. If your rankings have dropped, it's because of factors having to do with Google, not the add-on.

The fact that public PR is constant is irrelevant, especially since it may not even accurately reflect actual PR. Higher PR does, however, generally increase the frequency of spidering. Beyond that, your rankings depend on "over 100 factors" - and one of the biggest is what's happening for that specific search term on other sites also ranking for the search term.

Note that a sitemap doesn't guarantee that Googlebot will change it's crawling patterns.

kontrabass
05-10-2007, 06:38 PM
Thanks for the info.

One thing I've noticed is that the 'top' url in the sitemap I generate is my forum URL "www.mysite.com/forum". But I use vbadvanced with a homepage of "www.mysite.com". vbSEO is installed in my forum directory. I have set the sitemap URL set to my root homepage (www.mysite.com). I have also enabled the vba addon. Still though the root URL is listed as www.mysite.com/forum. Google obviously knows my homepage - but is it important for the sitemap to 'get it right' ?

djbaxter
05-10-2007, 11:43 PM
I don't use either vBadvanced or vBSEO (except for the sitemap add-on).

However, this may help:

How to ensure that your sitemaps can be found by ANY search engine...

Discovering Sitemaps (http://blogs.msdn.com/livesearch/archive/2007/04/11/discovering-sitemaps.aspx)
Brent Hands, Program Manager, Live Search

When we first teamed up with Google and Yahoo to support sitemaps as an industry standard (http://blogs.msdn.com/livesearch/archive/2006/11/15/microsoft-google-yahoo-unite-to-support-sitemaps.aspx), it was with the express intention of driving the protocol forward. Making it into a simple, effective way to tell all search engines about the structure of your site.

Today, I'm happy to announce the latest addition to the protocol: Sitemap Autodiscovery. Autodiscovery gives siteowners the ability to easily share their sitemaps with all search engines at once, without the overhead of manually submitting them to each one. In order to share your sitemap with the crawlers at large, you simply provide the following line in your robots.txt file:

Sitemap: <sitemap_location>

where <sitemap_location> is the complete URL of your Sitemap Index File (or your sitemap file, if you don't have an index file). This directive is independent of the user-agent. so as long as it is present in the robots.txt file, all engines will be able to find your sitemaps. I see this as an important extension to the protocol, as it removes the need to individually submit sitemaps to each engine - simply add one line to your robots.txt file, and we will find your new and updated sitemaps automatically.

Although we aren't ready to start consuming sitemaps quite yet, I encourage you to build a sitemap and add the "sitemap" directive to your robots.txt. As soon as we roll out support (before the end of the year), we will be able to start crawling your sitemap files immediately. If you want more detail on the sitemaps protocol, including autodiscovery, check out www.sitemaps.org (http://www.sitemaps.org/).

This is also endorsed by Yahoo! -

Webmasters Can Now Auto-Discover With Sitemaps (http://p7.hostingprod.com/@www.ysearchblog.com/archives/000437.html)

Since working with Google and Microsoft to support a single format for submission with Sitemaps, we have continued to discuss further enhancements to make it easy for webmasters to get their content to all search engines quickly.

All search crawlers recognize robots.txt (http://www.robotstxt.org/), so it seemed like a good idea to use that mechanism to allow webmasters to share their Sitemaps. You agreed and encouraged us to allow robots.txt discovery of Sitemaps (http://suggestions.yahoo.com/detail/?prop=SiteExplorer&fid=2854) on our suggestion board. We took the idea to Google and Microsoft and are happy to announce today that you can now find your sitemaps in a uniform way across all participating engines. To do this, simply add the following line to your robots.txt file:

Sitemap: http://www.example.com/sitemap.xml

Please provide the complete URL for your Sitemap on this line. We will pick it up wherever you put it in your robots.txt file. This directive is not specific to user-agent. If you have multiple Sitemaps, you can point to your Sitemap index file on this line. Details about the Sitemaps protocol including this addition are available on the protocol website -- http://www.sitemaps.org. (http://www.sitemaps.org/)

If you prefer, you can continue to issue Sitemaps to Yahoo! Search by simply inputting the URL for your Sitemap and submitting. Or add feeds to a site you are already managing under 'My Sites' in Site Explorer. This also allows us to provide more feedback to you about what we are doing with the sitemap.

We're also happy to have some east coasters, Ask and IBM, announce their support for Sitemaps. The more the merrier!

SoftDux
05-11-2007, 11:45 AM
Great script, thank you :)

kontrabass
05-11-2007, 03:14 PM
Sorry - I didn't mean to say I had vbSEO installed - just this sitemap mod. The sitemap autodiscovery protocol is very interesting - thanks.

I get a lot of different answers reading through these threads... I'm not really concerned about using a vbadvanced addon as I only have one vba page (my homepage). But for those who's home page is not their forum index, how should be ideally go about getting our root home page listed as the sitemap's top level location?

djbaxter
05-11-2007, 03:21 PM
See my post above: https://vborg.vbsupport.ru/showpost.php?p=1245275&postcount=98

kontrabass
05-11-2007, 04:31 PM
See my post above: https://vborg.vbsupport.ru/showpost.php?p=1245275&postcount=98

I understand, and have no problem with engines finding my sitemap. My concern is that in the sitemap, the 'homepage' is:

<url>
<loc>http://www.mysite.com/forum/</loc>
<priority>1</priority>
<lastmod>2007-05-10T10:10:07+00:00</lastmod>
<changefreq>daily</changefreq>
</url>


And my 'real' homepage of 'www.mysite.com' is not listed in the map. Maybe I have no reason to be concerned? I'm not sure how literally these sitemaps are interpreted.

iojam
05-11-2007, 05:41 PM
newforum,

your sitemap URL is: http://www.einvestorsforum.com/sitemap_index.xml.gz

kontrabass,

you can add your homepage in extra-urls.txt file.

baghdad4ever
05-11-2007, 07:15 PM
Great script, thank you

but how can i uninstall it in future???

kontrabass
05-14-2007, 02:00 PM
kontrabass,

you can add your homepage in extra-urls.txt file.

Sorry for all the questions... So what exactly is the purpose of the "Sitemap Files URL" setting in v2.0? I don't notice any difference if I leave this at default or enter my main root url...

djbaxter
05-14-2007, 02:09 PM
If you want your sitemap in the default location, leave it blank. If you want to specifiy where you want the add-on to generat the sitemap, enter that URL.

Sitemap Files URL
Enter the url to use for sitemap files in case if you want to specify non-default URLs. For instance: http://www.example.com

Leave this setting empty to use default vB url.

iojam
05-14-2007, 04:06 PM
baghdad4ever,

yes - you can uninstall xml product and remove mod's files.

DieselMinded
05-15-2007, 12:10 AM
Should i be having to Copy the "sitemap_index.xml.gz" from the vbseo_sitemap/data on to the root directory before i submit them ?

I did and submited to both Google and Yahoo seemed to work good , If this is the practice to foloow how often shall i do this?

DieselMinded
05-15-2007, 12:15 AM
On the bottom of the instructions it says "Using your browser, visit: http://www.yoursite.com/vB-root/vbseo_sitemap/. "

So I assume you drop the vbseo_sitemap"folder" on to the root How ever google and yahoo can only accept the xml files from the root directory

I think i done something wrong helpppppp

Ohiosweetheart
05-15-2007, 12:34 AM
lol - DM I'm not quite understanding - do you have this installed or are you having a problem with where to install it, or what?

DieselMinded
05-15-2007, 01:10 AM
I dont know either ...LOL I resorted to joing the Seo forum..

For a good Laff

http://www.vbseo.com/f44/newbie-here-issues-vbseo-sitemap-do-hicky-13619/

djbaxter
05-15-2007, 01:57 AM
Should i be having to Copy the "sitemap_index.xml.gz" from the vbseo_sitemap/data on to the root directory before i submit them ?

No. Leave it where it is and either use the included .htaccess file or add the lines specified in https://vborg.vbsupport.ru/showpost.php?p=1245275&postcount=98 to your robots.txt file.

I did and submited to both Google and Yahoo seemed to work good , If this is the practice to foloow how often shall i do this?

If you do this, you'll have to do it daily, or however often you have the cron job creating the sitemap files. Why do it the hard way? See above.

On the bottom of the instructions it says "Using your browser, visit: http://www.yoursite.com/vB-root/vbseo_sitemap/. "

So I assume you drop the vbseo_sitemap"folder" on to the root How ever google and yahoo can only accept the xml files from the root directory

Not true. The add-on includes instructions for redirecting to the vbseo_sitemap directory - add the lines to .htaccess. Or see my post above to tell Google, Yahoo, and MSN where to find your sitemap file.

lol - DM I'm not quite understanding

You should be accustomed to that by now. Read the thread.

DieselMinded
05-16-2007, 12:11 AM
I had to uninstall this My server does not allow changes in the .htaccesss file

DM

kontrabass
05-16-2007, 02:11 PM
If you want your sitemap in the default location, leave it blank. If you want to specifiy where you want the add-on to generat the sitemap, enter that URL.

Hmm... So theoretically, I would create a folder like "sitemap_data" in my www root, chmod it to 777, and then put in "http://www.mysite.com/sitemap_data/" into the URL setting field?

And then for autodiscovery I'd just put "sitemap: http://www.mysite.com/sitemap_data" into my robots.txt I guess...

So it sounds like the previous poster's .htaccess woes are moot ?

djbaxter
05-16-2007, 02:54 PM
Hmm... So theoretically, I would create a folder like "sitemap_data" in my www root, chmod it to 777, and then put in "http://www.mysite.com/sitemap_data/" into the URL setting field?

And then for autodiscovery I'd just put "sitemap: http://www.mysite.com/sitemap_data" into my robots.txt I guess...

So it sounds like the previous poster's .htaccess woes are moot ?

Correct. Follow all the instructions for installing the sitemap add-on but omit the .htaccess and use robots.txt to direct the bots.

kontrabass
05-16-2007, 03:08 PM
Correct. Follow all the instructions for installing the sitemap add-on but omit the .htaccess and use robots.txt to direct the bots.

Thanks for your insight and help :)

stagmite
05-17-2007, 01:22 AM
Thank you for this hack....it worked just fine.

DieselMinded
05-17-2007, 03:04 PM
robots.txt to direct the bots.

How do you do this ? wheres the robots.txt and do you mean put it on the root after every generation?

djbaxter
05-17-2007, 03:17 PM
How do you do this ? wheres the robots.txt and do you mean put it on the root after every generation?

It must be placed in the root folder of the domain or subdomain.


If your forum is at www.yoursite.com, place the robots.txt file at www.yoursite.com/robots.txt

If your forum is at www.yoursite.com/forum/, you still place the robots.txt file at www.yoursite.com/robots.txt

But if your forum is at forum.yoursite.com, place the robots.txt file at forum.yoursite.com/robots.txt

DieselMinded
05-17-2007, 03:35 PM
I do not have a robots.txt that i can see

I moved both the sitemap.xmls the index one and the "1" one to the root due to .htaccess issues
Where is this robot.txt file located ? and is the text regenerated with each update of the sitemaps ?

djbaxter
05-17-2007, 03:40 PM
I do not have a robots.txt that i can see

I moved both the sitemap.xmls the index one and the "1" one to the root due to .htaccess issues
Where is this robot.txt file located ? and is the text regenerated with each update of the sitemaps ?

The robots.txt file does not exist unless you create it.

Make sure you use a plain text editor and save it in ASCII or plain text format, NOT unicode.

DieselMinded
05-17-2007, 03:48 PM
Where do you get this information at so i dont have to ask 100 questions ?

What do i put on the txt file ?

If i put this text file on my root then set the robots up to read that file will it direct the bots to vbseo_sitemap/data/xml file

djbaxter
05-17-2007, 04:00 PM
<a href="http://www.robotstxt.org" target="_blank">http://www.robotstxt.org</a>

DieselMinded
05-17-2007, 04:06 PM
Thanks for the link Ill read up on them ;)

Look like all the robots.txt does is Disallow things what do i need to put in there for it to find the sitemap.xmls

DM

djbaxter
05-17-2007, 05:35 PM
Thanks for the link Ill read up on them ;)

Look like all the robots.txt does is Disallow things what do i need to put in there for it to find the sitemap.xmls

DM


Answered previously in this thread. See https://vborg.vbsupport.ru/showpost.php?p=1245275&postcount=98

DieselMinded
05-17-2007, 06:02 PM
Thank you ... Heres my robot.txt file Does it look right to you?

Sitemap: </vbseo_sitemap/data/sitemap_index.xml.gz>
User-agent: *
Disallow: /ajax.php
Disallow: /attachment.php
Disallow: /cron.php
Disallow: /editpost.php
Disallow: /image.php
Disallow: /inlinemod.php
Disallow: /joinrequests.php
Disallow: /login.php
Disallow: /misc.php
Disallow: /moderator.php
Disallow: /newattachment.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /poll.php
Disallow: /postings.php
Disallow: /private.php
Disallow: /register.php
Disallow: /report.php
Disallow: /reputation.php
Disallow: /search.php
Disallow: /sendmessage.php
Disallow: /showgroups.php
Disallow: /subscription.php
Disallow: /threadrate.php
Disallow: /usercp.php
Disallow: /usernote.php

djbaxter
05-18-2007, 12:09 AM
Thank you ... Heres my robot.txt file Does it look right to you?

Sitemap: </vbseo_sitemap/data/sitemap_index.xml.gz>
User-agent: *
Disallow: /ajax.php
Disallow: /attachment.php
Disallow: /cron.php
Disallow: /editpost.php
Disallow: /image.php
Disallow: /inlinemod.php
Disallow: /joinrequests.php
Disallow: /login.php
Disallow: /misc.php
Disallow: /moderator.php
Disallow: /newattachment.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /poll.php
Disallow: /postings.php
Disallow: /private.php
Disallow: /register.php
Disallow: /report.php
Disallow: /reputation.php
Disallow: /search.php
Disallow: /sendmessage.php
Disallow: /showgroups.php
Disallow: /subscription.php
Disallow: /threadrate.php
Disallow: /usercp.php
Disallow: /usernote.php

Not quite. Change it to the following:

User-agent: *
Disallow: /ajax.php
Disallow: /attachment.php
Disallow: /cron.php
Disallow: /editpost.php
Disallow: /image.php
Disallow: /inlinemod.php
Disallow: /joinrequests.php
Disallow: /login.php
Disallow: /misc.php
Disallow: /moderator.php
Disallow: /newattachment.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /poll.php
Disallow: /postings.php
Disallow: /private.php
Disallow: /register.php
Disallow: /report.php
Disallow: /reputation.php
Disallow: /search.php
Disallow: /sendmessage.php
Disallow: /showgroups.php
Disallow: /subscription.php
Disallow: /threadrate.php
Disallow: /usercp.php
Disallow: /usernote.php

Sitemap: http://www.yoursite.com/vbseo_sitemap/data/sitemap_index.xml.gz


Note the blank line before Sitemap: and no <> brackets. Also the URL must be a complete URL, including http:// etc.

See http://www.sitemaps.org/protocol.php#submit_robots

DieselMinded
05-18-2007, 01:23 AM
THANK YOU !!!!

Also See ...

http://www.vbseo.com/f44/newbie-here-issues-vbseo-sitemap-do-hicky-13619/

Im really trying to get this to work

Yellow Slider
05-18-2007, 12:37 PM
google bots are not indexing my pages for somthing like 2 weeks..
what could ne the problem? im using the generator for along time..
Results 1 - 10 of about 305,000 from atraf-f.net.
i do think that google is indexing new forums in my forums but there is no sign to new theards , there are only theards from 5\5 (maybe 1 or 2..) the rest are from april.. it a big issue for me.

what can i do? my forum is in hebrew, maybe one of the coders can see in the source if there is a problem that is cousing the bots to unindex my theards pages, thanks alot.

also, i went in one of the files, http://www.atraf-f.net/sitemap_46.xml.gz the latest one that was generated by the generator and i didnt see any pages from May 2007, there seemto be alot of pages from 2006 etc', how can i make the generator to include only theards \ pages from a certain date? thanks alot.

UaeStar
05-19-2007, 08:52 PM
nice thanks

dba2003
05-20-2007, 09:23 AM
Any resons why this should not work also on 3.7.x?

Can some one please send correctly download link to the latest version, thanks a bunch!

djbaxter
05-20-2007, 12:40 PM
Any resons why this should not work also on 3.7.x?

Can some one please send correctly download link to the latest version, thanks a bunch!


There is no 3.7x yet. I assume you mean 3.67PL1 - it works fine in that version.

As far as I know, the link to the latest version of the add-on is right here.

baghdad4ever
05-20-2007, 04:02 PM
after we make the site map we can delete th .htaccess file??

or not???

djbaxter
05-20-2007, 04:14 PM
after we make the site map we can delete th .htaccess file??

No. The .htaccess file tells spiders where to find your sitemap file. Only delete it if you use the robots.txt Sitemap: option.

djbaxter
05-20-2007, 06:11 PM
google bots are not indexing my pages for somthing like 2 weeks..
what could ne the problem? im using the generator for along time..
Results 1 - 10 of about 305,000 from atraf-f.net.
i do think that google is indexing new forums in my forums but there is no sign to new theards , there are only theards from 5\5 (maybe 1 or 2..) the rest are from april.. it a big issue for me.

what can i do? my forum is in hebrew, maybe one of the coders can see in the source if there is a problem that is cousing the bots to unindex my theards pages, thanks alot.

Google sitemaps tell Google WHAT to index, not when. Generating a sitemap is no guarantee of increased spidering. I can't read Hebrew but your forum seems to be an active one. The problem is your home page is only PR1, which does have an influence on how often and how deeply Google will spider your pages. Of course, that may be different in your regional Google...

also, i went in one of the files, http://www.atraf-f.net/sitemap_46.xml.gz the latest one that was generated by the generator and i didnt see any pages from May 2007, there seemto be alot of pages from 2006 etc', how can i make the generator to include only theards \ pages from a certain date? thanks alot.

If you're using this add-on, that may be the incorrect URL for the sitemap.

By default, the add-ons saves current sitemaps at http://www.atraf-f.net/vbseo_sitemap - look there. Also make sure you either have the .htaccess file present and updated with the mod_rewrite instructions so the SEs can locate the correct sitemap or use the robots.txt instruction to accomplish that task.

dba2003
05-21-2007, 03:38 AM
Thanks so much DJ Baxter!

Yes I was referring to 3.6.7 PL1 (sorry)

I have now successfully installed sitemap generator v 2.0. And after running a sitemap generator report it confirms successful pings to Yahoo & Google.:)

I am concerned about one thing however and would appreciate feedback/confirmation on one thing:

When I try to access my http//:www.myforum.com/vbroot/sitemap_index.xml.gz page I get an 500-error page. : (Yes, I have set the permissions to 777 for my vbseo_sitemapfolder/data/ folder.

I have been advise to add "Rewrite/vbroot/" in my ".htaccess" file. Problem is my .htaccess file is invisible on my server. Any tips on that OR any other solution to the 500 -error page where the site map is supposed to show.


Thanks alot.
Aussie Regards
Patrick

Dismounted
05-21-2007, 07:22 AM
Don't have it 777, have it 755, some servers have extra security enabled which causes this. Switching it to 755 would work fine.

dba2003
05-21-2007, 10:15 AM
Thanks so much for your tip Dismounted.

I have tried setting the CHMOD permissions to BOTH 777 and 755, however and I STILL get 500 error page... when trying to access the
http://www.myforum.com/vbroot/sitemap_index.xml.gz file

(I can of course see the actual file is inside its folder).

Dismounted
05-21-2007, 11:47 AM
Try 644.

Yellow Slider
05-21-2007, 12:48 PM
Google sitemaps tell Google WHAT to index, not when. Generating a sitemap is no guarantee of increased spidering. I can't read Hebrew but your forum seems to be an active one. The problem is your home page is only PR1, which does have an influence on how often and how deeply Google will spider your pages. Of course, that may be different in your regional Google...



If you're using this add-on, that may be the incorrect URL for the sitemap.

By default, the add-ons saves current sitemaps at http://www.atraf-f.net/vbseo_sitemap - look there. Also make sure you either have the .htaccess file present and updated with the mod_rewrite instructions so the SEs can locate the correct sitemap or use the robots.txt instruction to accomplish that task.

thanks, but google had stoped indexing new theards, it will index anything else, but threads, tomshing is wrong, the .htaccess file os fine, i can view the files by atraf-f.net/site... just beacause of the .htaccess file, they are stored in ttp://www.atraf-f.net/vbseo_sitemap/data, and the last sitemap that the generator made is the one i gave http://www.atraf-f.net/sitemap_30.xml.gz you can view it throw this URL but it's actually stored in vbseo_sitemap/data/ , and i don't see any new theards \ messages in the GZ files that the generator is generating..

a google bots had used to index our threads on a daily basic, and now we done some hanges in the theards pages and after redoing those changes google bots are not indexing new pages from my board, im telling you, the bots used to index our pages every day, and now there in no new thread page in google for sonthing like 2-3 weeks, what seems to be the problem?

djbaxter
05-21-2007, 01:24 PM
If the directory isn't write enabled (766 or 777), how do you expect the add-on to actually write the sitemap file?

I have been advise to add "Rewrite/vbroot/" in my ".htaccess" file. Problem is my .htaccess file is invisible on my server. Any tips on that OR any other solution to the 500 -error page where the site map is supposed to show.

The .htaccess file is usually a hidden/system file. If you check it with an FTP program, you can usually set the program to show hidden files.

Can you post the portion of your .htaccess file with the mod_rewrite lines here?

dba2003
05-21-2007, 01:45 PM
Dj Baxter, Thanks,

Yes, The datafolder is set to CHMOD 777 (thanks).

I use Cute FTP Home ver 7.2 I am unsucessfully pulling my hair to find an option to enable viewing of hidden files-system files.. If I could I would be post the .htaccess code-s here and grateful for you you to have a look.

When and if I find a way to access the .htaccess file I will post it, thanks

Cheers

Patrick

djbaxter
05-21-2007, 02:54 PM
I don't use Cute FTP. However, I've used several others, my current favorite being FileZilla.

Look in options or settings for something like "Show hidden files" (settings | interface settings | remote file list in FileZilla) or check the help file (I remember in WS_FTP one had to enter an obscure file string to enable this).

arena
05-22-2007, 12:12 AM
SE Bots Activity Log not working help me please

DeeperImage
05-25-2007, 05:26 PM
I had installed a previous version of this mod. Now that I upgraded to the 3.6.x version, I'm getting this message when I try to "run the Site Map Generator." I checked permission and changed them as the .doc instructed so.



Warning: gzopen(/xxxx/xxxxx/public_html/forums/vbseo_sitemap/data/sitemap_1.xml.gz) [function.gzopen]: failed to open stream: Permission denied in /xxxx/xxxxx/public_html/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 540

Warning: gzopen(/xxxx/xxxxx/public_html/forums/vbseo_sitemap/data/urllist.txt.gz) [function.gzopen]: failed to open stream: Permission denied in /xxxx/xxxxx/public_html/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 544

Warning: gzwrite(): supplied argument is not a valid stream resource in /xxxx/xxxxx/public_html/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 554

Thanks

Yellow Slider
05-27-2007, 04:58 PM
thanks, but google had stoped indexing new theards, it will index anything else, but threads, tomshing is wrong, the .htaccess file os fine, i can view the files by atraf-f.net/site... just beacause of the .htaccess file, they are stored in ttp://www.atraf-f.net/vbseo_sitemap/data, and the last sitemap that the generator made is the one i gave http://www.atraf-f.net/sitemap_30.xml.gz you can view it throw this URL but it's actually stored in vbseo_sitemap/data/ , and i don't see any new theards \ messages in the GZ files that the generator is generating..

a google bots had used to index our threads on a daily basic, and now we done some hanges in the theards pages and after redoing those changes google bots are not indexing new pages from my board, im telling you, the bots used to index our pages every day, and now there in no new thread page in google for sonthing like 2-3 weeks, what seems to be the problem?

lets say the generator had generated the sitemaps, and there were somthing like 5000 posts that day, those posts will be in the last sitemap file? (let say num' 30 out of 30 )

cause i don't think that links to new posts are generated into the sitemap files, i cant find any new link to new theards in my forum in my sitemaps files..
what is the problem?

Alibass
05-27-2007, 09:34 PM
*Installed*

fly2hi
05-28-2007, 03:28 AM
hi
why its saving the filre here vb/vbseo_sitemap/data/sitemap_index.xml.gz
i need it to be under vb/
i did as you instracted but no changes
i did change htaccess file
and every thing looks to be just fine but still i can not have the files added to my root folder

thanks

deathemperor
05-28-2007, 02:24 PM
This version has a kind of serious bug if your forum is a big one:

it adds another cron job which do the exact same thing to the old one which will double the queries.

I think this only happens with an upgrade which is the most method.

To fix this bugs yourself forum owners just disable or delete one of the 2 tasks.

djbaxter
05-28-2007, 02:32 PM
This version has a kind of serious bug if your forum is a big one:

it adds another cron job which do the exact same thing to the old one which will double the queries.

I think this only happens with an upgrade which is the most method.

To fix this bugs yourself forum owners just disable or delete one of the 2 tasks.

No. I thought the same but doing that will make your sitemap invalid. I think the second cron job is called by the first and is necessary to compress the sitemap files - it may be needed for other things too.

DeeperImage
05-29-2007, 01:25 AM
I had installed a previous version of this mod. Now that I upgraded to the 3.6.x version, I'm getting this message when I try to "run the Site Map Generator." I checked permission and changed them as the .doc instructed so.



Warning: gzopen(/xxxx/xxxxx/public_html/forums/vbseo_sitemap/data/sitemap_1.xml.gz) [function.gzopen]: failed to open stream: Permission denied in /xxxx/xxxxx/public_html/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 540

Warning: gzopen(/xxxx/xxxxx/public_html/forums/vbseo_sitemap/data/urllist.txt.gz) [function.gzopen]: failed to open stream: Permission denied in /xxxx/xxxxx/public_html/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 544

Warning: gzwrite(): supplied argument is not a valid stream resource in /xxxx/xxxxx/public_html/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 554

Thanks

Anyone?

Jedric
05-29-2007, 01:57 AM
Sorry if I missed anyone else with this problem.

I seem to not be getting any sitemaps generated.
If you go to http://www.forumscitadel.com/sitemap_index.xml.gz you will see that it says "Sitemap file not found". Did I not change something I was supposed to? Would it be because I only have 1 user, 1 thread, and only a few replies?

I have generated my sitemap a few times, and it is not giving me any errors.

djbaxter
05-29-2007, 11:25 AM
Anyone?

Is gzip installed and enabled on your server?

If so, check that your Scheduled Tasks shows TWO (2) cron jobs for this add-on. It seems that without both, the cron job doesn't complete properly.

Then double-check all your sitemap settings.

I seem to not be getting any sitemaps generated.
If you go to http://www.forumscitadel.com/sitemap_index.xml.gz you will see that it says "Sitemap file not found".

That's not where you'll find the sitemap, unless you changed it in the options. By default, you'll find it at http://www.forumscitadel.com/vbseo_sitemap/data/sitemap_index.xml.gz - that's why it's important to add the .htaccess lines.

Jedric
05-29-2007, 07:50 PM
I followed the directions, and it said to put the .htaccess in the forum root, which is where it is. I tried putting it elsewhere and it doesn't even find a file. The problem is that it is not generating a sitemap or something. Even when I pull up http://www.forumscitadel.com/vbseo_sitemap/vbseo_getsitemap.php?sitemap=index directly it will not work.

iojam
05-30-2007, 03:44 PM
Jedric,

check if you have sitemap files in your vbseo_sitemap/data/ folder. Do you get any errors if you execute Sitemap Generator manually?

HawKe
05-30-2007, 05:34 PM
Running vBulletin 3.6.7 PL1

I have (to the best of my knowledge) installed this per the instructions, uploading the upload folder and .htaccess file successfully, etc... I did not modify the sitemap files URL for example...

When I go to the URL specified for Google Sitemaps (http://forums.audioholics.com/forums/sitemap_index.xml.gz) It's as if the plug-in never did anything after it was installed. I have re-run it and verified that I checked that vbSEO isn't installed... (first options item set to 'No')

Any ideas?

Jedric
05-31-2007, 04:11 AM
I figured it out. The data folder didn't have write access. Hawke, make sure that you create the data folder and CHMOD it 777. I had the exact same issue as you did.

kollam003
05-31-2007, 05:53 AM
thanks guys just installed i hope i did all the installs fine :)


Thanks once again for the hardwork

Yellow Slider
05-31-2007, 09:10 AM
for something like 4 weeks, Google isn't indexing any new threads from my forum, i have something like 300,000 pages in google, somthing is wrong, Google is indexing any other page that i have on my forum like http://www.atraf-f.net/awards.php (was indexed a day after we added this page) but google bots are not indexing any new messages, what seems to be the problem ? here is an exmpale for a thread, http://www.atraf-f.net/showthread.php?t=225909 maybe something in the code is wrong and cousin bot to not index any new posts?
a link to my board http://www.atraf-f.net

please, try to help me ( p.s im using vbseo sitemap. ) , thanks.

djbaxter
05-31-2007, 11:08 AM
for something like 4 weeks, Google isn't indexing any new threads from my forum, i have something like 300,000 pages in google, somthing is wrong, Google is indexing any other page that i have on my forum like http://www.atraf-f.net/awards.php (was indexed a day after we added this page) but google bots are not indexing any new messages, what seems to be the problem ? here is an exmpale for a thread, http://www.atraf-f.net/showthread.php?t=225909 maybe something in the code is wrong and cousin bot to not index any new posts?
a link to my board http://www.atraf-f.net

please, try to help me ( p.s im using vbseo sitemap. ) , thanks.

Admin CP | *[vbseo]* | vbseo sitemap settings

Check the following settings:

Max URLs in Sitemap Files 50000
Specify the maximum number of URLs to be included in each sitemap file.
NOTE: Google allows no more than 50,000 URLs per file.

Include Show Post Pages Yes
Select "Yes" to include your show post pages in your sitemaps (showpost.php).

Include Member Profile Pages No
Select "Yes" to include your member profile pages in your sitemaps (member.php).

Include Archive Pages No
Select "Yes" to include your show archive pages in your sitemaps (archive/index.php).

Include Show Thread Pages Yes
Select "Yes" to include your show thread pages in your sitemaps (showthread.php).

Include Forum Display Pages Yes
Select "Yes" to include your forum display pages in your sitemaps (forumdisplay.php).

Include Poll Results Pages No
Select "Yes" to include your poll results pages in your sitemaps (poll.php).

Excluded Forums List ??????
Specify the forum ID for all forums that you do NOT wish to be included in your sitemaps.
NOTE: Separate multiple forum IDs with spaces.

Auto-Notify Google
Select "Yes" to automatically notify Google of your updated sitemap each time it is generated.
NOTE: Notification is sent via a HTTP request to the Google servers.

Yellow Slider
05-31-2007, 05:29 PM
Admin CP | *[vbseo]* | vbseo sitemap settings

Check the following settings:

Max URLs in Sitemap Files 50000
Specify the maximum number of URLs to be included in each sitemap file.
NOTE: Google allows no more than 50,000 URLs per file.

Include Show Post Pages Yes
Select "Yes" to include your show post pages in your sitemaps (showpost.php).

Include Member Profile Pages No
Select "Yes" to include your member profile pages in your sitemaps (member.php).

Include Archive Pages No
Select "Yes" to include your show archive pages in your sitemaps (archive/index.php).

Include Show Thread Pages Yes
Select "Yes" to include your show thread pages in your sitemaps (showthread.php).

Include Forum Display Pages Yes
Select "Yes" to include your forum display pages in your sitemaps (forumdisplay.php).

Include Poll Results Pages No
Select "Yes" to include your poll results pages in your sitemaps (poll.php).

Excluded Forums List ??????
Specify the forum ID for all forums that you do NOT wish to be included in your sitemaps.
NOTE: Separate multiple forum IDs with spaces.

Auto-Notify Google
Select "Yes" to automatically notify Google of your updated sitemap each time it is generated.
NOTE: Notification is sent via a HTTP request to the Google servers.

i have it "Max URLs in Sitemap Files 50000" with 5000 links per sitemap, i had no on Include Show Post Pages and yes on archive, changed all except the number of links per sitemap, thanks for trien to help.

djbaxter
05-31-2007, 05:37 PM
i have it "Max URLs in Sitemap Files 50000" with 5000 links per sitemap, i had no on Include Show Post Pages and yes on archive, changed all except the number of links per sitemap, thanks for trien to help.

You want "Yes" to "Show Post Pages", and "Yes" to "Show thread pages" and "No" to show archive.

Philipaclayton
05-31-2007, 08:41 PM
everyone really seems to love this hack/mod,

but what is it? care to explain :) thanks

djbaxter
06-01-2007, 01:10 AM
everyone really seems to love this hack/mod,

but what is it? care to explain :) thanks

It should be evident from the title.

If it isn't evident for you, read the thread.

if you still don't understand, see this: http://www.google.com/search?sourceid=navclient&ie=UTF-8&rls=GGLJ,GGLJ:2006-29,GGLJ:en&q=google+sitemaps

If you still don't understand what it does, don't install it.

Ohiosweetheart
06-05-2007, 01:49 PM
This add-on has really improved the traffic on my sites.
I'm now recommending it to all of my clients. :)

fly2hi
06-05-2007, 05:05 PM
its realy good one i can see changes
thanks for this amazing addon

HawKe
06-06-2007, 12:07 PM
On my system the "sitemap_index.xml.gz" file never gets written. Neither where it is supposed to be or anywhere else.

I have gotten the Sitemap Generator to run, meaning that it shows the output on the screen as having been run. The scheduled task is also correctly running and has been for several days.

Has anyone run it with the "vBSEO Installed?" option set to 'NO'? This is how I am running it for now since I have not installed vBSEO. My sitemap file is not in any of the locations it might be in:

http://forums.audioholics.com/forums/sitemap_index.xml.gz
http://forums.audioholics.com/forums/vbseo_sitemap/sitemap_index.xml.gz
http://forums.audioholics.com/forums/vbseo_sitemap/data/sitemap_index.xml.gz

Any ideas? It seems to be running and I can access my vBSEO Google / Yahoo Sitemap for vBulletin page, but no sitemap is ever generated.

djbaxter
06-06-2007, 12:20 PM
On my system the "sitemap_index.xml.gz" file never gets written. Neither where it is supposed to be or anywhere else.

I have gotten the Sitemap Generator to run, meaning that it shows the output on the screen as having been run. The scheduled task is also correctly running and has been for several days.

Has anyone run it with the "vBSEO Installed?" option set to 'NO'? This is how I am running it for now since I have not installed vBSEO. My sitemap file is not in any of the locations it might be in:

http://forums.audioholics.com/forums/sitemap_index.xml.gz
http://forums.audioholics.com/forums/vbseo_sitemap/sitemap_index.xml.gz
http://forums.audioholics.com/forums/vbseo_sitemap/data/sitemap_index.xml.gz

Any ideas? It seems to be running and I can access my vBSEO Google / Yahoo Sitemap for vBulletin page, but no sitemap is ever generated.


Yep. I'm running it without vBSEO installed. There's no chance I will ever have vBSEO installed.

Some things to check:

1. Have you checked the write permissions on those directories? Is your server running in safe mode?

2. Do you have anything in the box next to Sitemap Files URL?

3. Does your host support gzip?

4. Have you added the lines to the .htaccess file in your forum root (it should be at http://forums.audioholics.com/ - why do you have both a subdomain and a subdirectory for your forum, by the way?).

HawKe
06-06-2007, 02:22 PM
Thanks for your help and feedback. It's appreciated.

1. Yes, permissions are correct and I am not getting any (visible) errors. Server is not running in safe mode.

2. Nothing at all.

3. Yes it does.

4. I uploaded the .htaccess file that came with the mod:

RewriteEngine On
RewriteRule ^((urllist|sitemap).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]

The subdirectory shouldn't (specifically) be causing any problems and is there due to the fact that the forums once existed on the same server as the main site and was later split off.

I'm honestly at a loss...

djbaxter
06-06-2007, 02:49 PM
If you check those locations via FTP, do you see anything at all?

HawKe
06-06-2007, 04:20 PM
I see all the other files that are part of the mod/system... I've attached some screenshots.

Thanks again for helping. It seems to do everything except write the file.

djbaxter
06-06-2007, 04:23 PM
Anything at all in your scheduled tasks logs?

djbaxter
06-06-2007, 04:55 PM
Also:

Do you see TWO entries in your scheduled task manager:

vbseo_sitemap_task

vBSEO Sitemap Generator

Both seem to be necessary to complete this task.

Jedric
06-07-2007, 08:40 AM
Make sure to CHMOD your "data" folder 777 and it should work. I had the exact same problem as you did.

JustJon
06-09-2007, 01:56 AM
I have this installed and everything is generating properly in the data folder, but the .htaccess isn't pointing to the site map in the data directory. Is there something I did wrong when installing it?

djbaxter
06-09-2007, 01:20 PM
1. Did you add the appropriate lines to the .htacess file in your ROOT folder?

2. Can you post your .htaccess file here?

erhanerhan_5
06-11-2007, 03:31 AM
Which sitemap(s) for google and yahoo? can you tell me?
Thanks...

HawKe
06-12-2007, 12:30 PM
Very odd, the chmod to the data folder solved it, though I then had to alter the default directory so that the sitemap file referenced that folder. Obviously something in my setup causes it to not put it into root.

JustJon
06-12-2007, 04:04 PM
1. Did you add the appropriate lines to the .htacess file in your ROOT folder?

2. Can you post your .htaccess file here?

I didn't have any .htaccess before this. In fact, I had to AllowOverride in my http.conf just to add it. I used the .htaccess code posted above.

thebassman
06-13-2007, 02:26 AM
I'm getting the following errors. Help!

Warning: gzopen(/home/photogra/public_html/forum/vbseo_sitemap/data/sitemap_1.xml.gz): failed to open stream: Permission denied in /home/photogra/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 540

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/photogra/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 554

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/photogra/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 565

djbaxter
06-13-2007, 02:31 AM
I'm getting the following errors. Help!

Warning: gzopen(/home/photogra/public_html/forum/vbseo_sitemap/data/sitemap_1.xml.gz): failed to open stream: Permission denied in /home/photogra/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 540

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/photogra/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 554

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/photogra/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 565


It's a permissions issue. Change the permissions for /home/photogra/public_html/forum/vbseo_sitemap/ to 777.

thebassman
06-13-2007, 02:42 AM
Not the vbseo_sitemap folder, but just the data folder, I assume. Anyways, it looks like it worked. ;) Cheers.

thebassman
06-13-2007, 03:04 AM
Ok, I've got the sitemap to run without errors, but all the sitemaps are coming up 404's... http://www.photographycorner.com/sitemap_index.xml.gz ???

djbaxter
06-13-2007, 11:21 AM
Ok, I've got the sitemap to run without errors, but all the sitemaps are coming up 404's... http://www.photographycorner.com/sitemap_index.xml.gz ???

Unless you specifically changed the location of the sitemap, this add-on does NOT place it in the root directory where search engines expect to find it.

Instead, you'll find it at /{forum root}/vbseo_sitemap/. You need to add the following lines to your .htaccess file to redirect Google and friends to the correct location:

RewriteEngine On
RewriteRule ^((urllist|sitemap).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]

If you altered the default location, I suggest you remove that entry in options. Others have reported difficulty with using that option.

Are you able to access it from the vBSEO options panel in your Admin CP?

thebassman
06-13-2007, 06:17 PM
Yeah, I added that to my htaccess file, but I have a custom 404 set up as well, which may be causing problems. I'll have to get my programmer to take a look, I think.

bryandailey
06-14-2007, 12:07 AM
Everytime i try to download this, it just takes me to this link

https://vborg.vbsupport.ru/showthread.php?t=144730

I'm logged in but it's not letting me dowload the files.

help!
Bryan

CMGU
06-14-2007, 12:40 AM
thanks.....

manutdvn
06-14-2007, 12:52 AM
Hello,

I have a question.

In case, I upgrade to new version of vbulletin, do I have to install this hack again? or if I want to uninstall this hack, is there any problem with my forum?

Thanks.

djbaxter
06-14-2007, 01:25 AM
Everytime i try to download this, it just takes me to this link

https://vborg.vbsupport.ru/showthread.php?t=144730

I'm logged in but it's not letting me dowload the files.

help!
Bryan

Has your license/support term expired?

Hello,

I have a question.

In case, I upgrade to new version of vbulletin, do I have to install this hack again? or if I want to uninstall this hack, is there any problem with my forum?

That's two questions.

The answers are:

1. No.

2. No.

manutdvn
06-14-2007, 01:44 AM
That's two questions.

The answers are:

1. No.

2. No.

^^ yes, that was 2 questions. :D Thanks for your reply.

One more question, how can I download vBSEO 3.0.0?

baghdad4ever
06-15-2007, 05:34 PM
hi

today im going to

Show Sitemap Downloads Log

and i found 40 pages

how can i delete this reports ???

thanks

djbaxter
06-16-2007, 12:08 AM
hi

today I'm going to

Show Sitemap Downloads Log


and i found 40 pages

how can i delete this reports ???


thanks

This is the most annoying feature of this add-on. There should be a way to turn off the reports and the download reports from accumulating on your server.

As it stands, you have to go through them page by page, highlight them, and click on delete.

Pain in the ass! :mad:

baghdad4ever
06-16-2007, 08:44 AM
This is the most annoyoiung feature of this add-on. There should be a way to turn off the reports and the download reports from accumulating on your server.

As it stands, you have to go through them page by page, highlight them, and click on delete.

Pain in the ass! :mad:

:eek::eek::eek::eek:

thanks for reply

PamelaE
06-17-2007, 08:04 PM
Ok my site guru was adding this and has overwritten the original .httpaccess file.

What are the consequences of that ?

da420
06-17-2007, 08:08 PM
That all depends on if you had any information in your original .htaccess file, and what that info was..

djbaxter
06-17-2007, 08:09 PM
Ok my site guru was adding this and has overwritten the original .httpaccess file.

What are the consequences of that ?

He's not much of a "guru", is he?

What the consequences will be depends on what was there before. Is your site enabled for Microsoft FrontPage? That is one of the bad scenarios although it can be relatively easily fixed.

Were you using mod_rewrite on your site? What other SEO add-ons are you using?

PamelaE
06-17-2007, 08:13 PM
Yes his guru title is officially revoked :)

We don't have any SEO add-ons.

The rest I have no idea. I will need to find out. But I dont think so, why would it be enabled for frontpage ?

Thanks :)

djbaxter
06-17-2007, 08:19 PM
Yes his guru title is officially revoked :)

We don't have any SEO add-ons.

The rest I have no idea. I will need to find out. But I dont think so, why would it be enabled for frontpage ?

Thanks :)

FrontPage is a WYSIWYG web site designer and manager, kinda like Dreamweaver. If you're not using it, then don't worry about it.

Post (or PM me) the link to your forum. I'll have a look at it.

PamelaE
06-17-2007, 08:44 PM
Thanks, its http://www.soapchat.net

Actually if I go to google and type in soap chat our forum is nowhere to be found but we are a busy community.

I have not bothered looking into search engine optimisation before.

djbaxter
06-17-2007, 09:35 PM
http://www.google.com/search?sourceid=navclient&ie=UTF-8&rls=GGLJ,GGLJ:2006-29,GGLJ:en&q=site%3awww%2esoapchat%2enet

Results 1 - 10 of about 45,100 from www.soapchat.net

You have an active forum. I think some things could be improved there in terms of SEO but it's not terrible. However, "soap chat" isn't a phrase you should expect to rank well for, since you're not really optimizing for that, as far as I can tell. You do better for "soapchat" (all one word).

What you need to do is to think about what search terms people are likely to type into that search box when they're looking for a forum like yours. Then you need to optimize for those terms. See my article on Basic Forum SEO (http://www.theadminzone.com/forums/articles.php?do=viewarticle&aid=36247).

But back to your question, your links, etc., all seem to be working okay. I don't see any obvious damage done by overwriting the previous .htaccess file.

What I would suggest is adding the following lines to the top of the current .htacess file:

Options -Indexes
php_flag register_globals 0

pictureboarduk
06-17-2007, 10:30 PM
Quick question, in the install docs it says to upload the .htaccess file.

Do you just upload the single .htaccess file OR the whole htaccess folder?

The folder contains other files, if I just upload the one .htaccess file, these other files won't get uploaded.

Thanks!..

djbaxter
06-18-2007, 12:03 AM
Just the .htaccess file. The other files are readme files only.

But read the posts just above yours: If you already have an .htaccess file, you want to ADD the lines from the add-on .htaccess file to the bottom of the existinfg .htaccess file so you do not overwrite what's already there.

pictureboarduk
06-19-2007, 12:03 PM
Has anyone managed to get this to work on a GoDaddy hosted site?

mlomenzo
06-19-2007, 03:41 PM
I have tried everything that I have found on this post to try to fix this. 1st No matter what I put in the Sitemap Files URL field, i get 404'd when i try to access them. I have tried every different permission combination that I could and nothing. I have moved the files and moved them back. Still nothing. My HTACCESS file is exactly as it should be. Google reports same thing 404 not found no matter where i place the files. **screams** I need help!

Thanks:eek:

pictureboarduk
06-20-2007, 01:23 AM
I have tried everything that I have found on this post to try to fix this. 1st No matter what I put in the Sitemap Files URL field, i get 404'd when i try to access them. I have tried every different permission combination that I could and nothing. I have moved the files and moved them back. Still nothing. My HTACCESS file is exactly as it should be. Google reports same thing 404 not found no matter where i place the files. **screams** I need help!

Thanks:eek:

I have exactly the same problem and after bugging vbSEO on there forum they finally admitted that unless your host allows PHP files to be used via the mod_rewrite then it won't work.

Often hosts allow mod_rewrite, but NOT for PHP files (GoDaddy for one).

The staff at vbSEO wasted my time saying 'do this' and 'do that' when surely they know that it doesn't work with GoDaddy.

Really disappointed with them, won't be ordering vbSEO now.

ShawneyJ
06-20-2007, 05:37 AM
i just cant get the prick to work lol.

WarDoGG
06-21-2007, 02:45 PM
My sitemap has generated

Total URLs 17,226 (+322)
Forumdisplay URLs 214 (+6)
Showthread URLs 3,203 (+57)
ShowPost URLs 10,833 (+198)

in the past 1 month. . but it doesnt show any bots download activity.

I tried manually adding the sitemap to "Google Webmaster Tools" but google says the sitemap cannot be found. Also, if i FTP to my root folder, i cant locate the sitemap_1.xml.gz file even though VBSEO says its been created.

I get this error while submitting to google manually :

General HTTP error: 404 not found
We encountered an error while trying to access your Sitemap. Please ensure your Sitemap follows our guidelines and can be accessed at the location you provided and then resubmit.

I dont understand the .gz format, because i think Google requires sitemaps in XML format ?

djbaxter
06-21-2007, 03:32 PM
.gz is gzip, a compressed file format. Google is fine with that

unknownkind
06-22-2007, 01:00 AM
Okay I have a few questions and hopefully someone can explain them to me....

I installed this hack fine and everything seems to be working fine or at least I hope so...
My site map is located at http://www.mysite.net/forums/sitemap_index.xml.gz. I added a robots.txt and put inside http://www.mysite.net/forums/sitemap_index.xml.gz. Well I went to google add my sitemap and put the link in and it loaded.. How will it upload to google automatically? Also whats the point of have .htaccess? Is it needed? Is robots.txt needed or should I get rid of it..? In the vBSEO settings theres a spot for your "Yahoo ID", but I thought this hack doesn't auto upload to yahoo? Whats the point of having the ID?


The Yahoo sitemap must be manually submitted to http://submit.search.yahoo.com/free/request/.


I saw someone put this for his robots.txt


User-agent: *
Disallow: /ajax.php
Disallow: /attachment.php
Disallow: /cron.php
Disallow: /editpost.php
Disallow: /image.php
Disallow: /inlinemod.php
Disallow: /joinrequests.php
Disallow: /login.php
Disallow: /misc.php
Disallow: /moderator.php
Disallow: /newattachment.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /poll.php
Disallow: /postings.php
Disallow: /private.php
Disallow: /register.php
Disallow: /report.php
Disallow: /reputation.php
Disallow: /search.php
Disallow: /sendmessage.php
Disallow: /showgroups.php
Disallow: /subscription.php
Disallow: /threadrate.php
Disallow: /usercp.php
Disallow: /usernote.php

Sitemap: http://www.mysite.net/forums/sitemap_index.xml.gz


Is all that necessary or do I just need the Sitemap: http://www. etc..........

Thanks for the much needed help!

--UnknownKind

Hopefully this also clears up the same problems other people are having....

Kiros72
06-22-2007, 02:42 PM
Very nice work! Can't wait to see the results! But I have a couple problems...

My website is running vBulletin in a /forums/ folder (ex: http://www.domain.com/forums/) and I have a normal website in my root (not vBadvanced or some other portal). I added my root website to the extra-urls.txt in hopes that it will be added to the sitemap. I also set my root as the Sitemap URL, expecting the sitemaps (or atleast the sitemap index) to be generated in my root (http://www.domain.com/sitemap_index.xml.gz).

Problem part::
I just ran the scheduled task to see if it would generate a new sitemap index in the root and no dice. It didn't even generate it in the default vBulletin directory (/forums/). The only place that it is stored is http://www.domain.com/forums/vbseo_sitemap/data/sitemap_index.xml.gz.
And now I just got a few errors in my log complaining that there was no file http://www.domain.com/vbseo_sitemap/vbseo_getsitemap.php (no /forums/).

So anyone know what's going on?

The problem was that I had to include "forums/" in the .htaccess instead of just "vbseo_sitemap/..." which I didn't realize until I actually took a look at it :D


But I have another bit... I only want Google and Yahoo! to use the archive, so I disabled use of showthread, showpost, member profiles, etc. and only let the sitemaps include the archive. The reason is that I think that search engines can focus more on the content than menu/other links and plus, Yahoo! Slurps have been creating some decent server load, so I think that it might be better with no advanced GUI. Is this a good idea or not?

And a new problem:

Now that spiders are crawling my archive, some of them are not taking the archive/index.php/ as a directory. I'm getting error logs like "File not found: /forums/archive/f-86.html." I don't want to have to edit the archiving script to include index.php/ in front of every one of its links. I'd much rather use a .htaccess type of thing. Does anyone know how I could do the following in .htaccess?

Redirect anything trying to get a *.html file in the /archive/ directory TO /archive/index.php/%filename%

(Where %filename% is the *.html file that the client was trying to get)

Anyone? :)

pictureboarduk
06-22-2007, 09:01 PM
Has anyone got this to work on GoDaddy at all?

WarDoGG
06-23-2007, 02:11 PM
My sitemap has generated



in the past 1 month. . but it doesnt show any bots download activity.

I tried manually adding the sitemap to "Google Webmaster Tools" but google says the sitemap cannot be found. Also, if i FTP to my root folder, i cant locate the sitemap_1.xml.gz file even though VBSEO says its been created.

I get this error while submitting to google manually :



I dont understand the .gz format, because i think Google requires sitemaps in XML format ?

ok i just realized this mod is storing sitemaps in /vbseo_sitemap/data folder !! how do i make it save it in my root forum directory ??

djbaxter
06-23-2007, 02:27 PM
ok i just realized this mod is storing sitemaps in /vbseo_sitemap/data folder !! how do i make it save it in my root forum directory ??

Look in your Admin CP for the options for this add-on.

dealxa
06-26-2007, 05:44 AM
i install this hack, but i make "run sitemap generator", i see this problem:
[homepage] [2,692.1Kb mem used] [0s (+0s)]
[SECTION START] forumdisplay [2,692.1Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 1, total threads: 0, pages: 1 [2,692.2Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 2, total threads: 0, pages: 1 [2,692.2Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 5, total threads: 0, pages: 1 [2,692.3Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 6, total threads: 0, pages: 1 [2,692.4Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 3, total threads: 0, pages: 1 [2,692.5Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 4, total threads: 0, pages: 1 [2,692.7Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 8, total threads: 0, pages: 1 [2,692.7Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 7, total threads: 0, pages: 1 [2,692.8Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 9, total threads: 0, pages: 1 [2,692.9Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 10, total threads: 0, pages: 1 [2,693.0Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 11, total threads: 0, pages: 1 [2,693.2Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 12, total threads: 0, pages: 1 [2,693.4Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 13, total threads: 0, pages: 1 [2,693.6Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 14, total threads: 0, pages: 1 [2,693.9Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 15, total threads: 0, pages: 1 [2,694.2Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 16, total threads: 0, pages: 1 [2,694.5Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 17, total threads: 0, pages: 1 [2,694.8Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 18, total threads: 0, pages: 1 [2,695.1Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 19, total threads: 0, pages: 1 [2,695.4Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 20, total threads: 0, pages: 1 [2,695.7Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 21, total threads: 0, pages: 1 [2,696.0Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 22, total threads: 0, pages: 1 [2,696.3Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 23, total threads: 0, pages: 1 [2,696.6Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 24, total threads: 0, pages: 1 [2,696.8Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 25, total threads: 0, pages: 1 [2,697.1Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 26, total threads: 0, pages: 1 [2,697.4Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 27, total threads: 0, pages: 1 [2,697.7Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 28, total threads: 0, pages: 1 [2,698.1Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 29, total threads: 0, pages: 1 [2,698.5Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 30, total threads: 2, pages: 1 [2,698.7Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 40, total threads: 0, pages: 1 [2,699.0Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 41, total threads: 0, pages: 1 [2,699.2Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 42, total threads: 4, pages: 1 [2,699.7Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 43, total threads: 0, pages: 1 [2,700.0Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 31, total threads: 13, pages: 1 [2,700.3Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 37, total threads: 0, pages: 1 [2,700.5Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 38, total threads: 0, pages: 1 [2,700.9Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 39, total threads: 0, pages: 1 [2,701.3Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 32, total threads: 0, pages: 1 [2,701.7Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 33, total threads: 0, pages: 1 [2,702.1Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 34, total threads: 0, pages: 1 [2,702.6Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 35, total threads: 4, pages: 1 [2,703.1Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 36, total threads: 0, pages: 1 [2,703.6Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 44, total threads: 0, pages: 1 [2,704.0Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 45, total threads: 0, pages: 1 [2,704.5Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 46, total threads: 0, pages: 1 [2,705.0Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 47, total threads: 0, pages: 1 [2,705.6Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 48, total threads: 0, pages: 1 [2,706.1Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 49, total threads: 0, pages: 1 [2,706.7Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 50, total threads: 0, pages: 1 [2,707.4Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 51, total threads: 0, pages: 1 [2,708.2Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 52, total threads: 0, pages: 1 [2,709.2Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 53, total threads: 0, pages: 1 [2,710.1Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 54, total threads: 0, pages: 1 [2,711.0Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 55, total threads: 0, pages: 1 [2,712.0Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 56, total threads: 0, pages: 1 [2,712.9Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 57, total threads: 0, pages: 1 [2,713.8Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 58, total threads: 0, pages: 1 [2,714.8Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 59, total threads: 0, pages: 1 [2,715.7Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 60, total threads: 0, pages: 1 [2,716.6Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 61, total threads: 0, pages: 1 [2,717.5Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 62, total threads: 0, pages: 1 [2,718.5Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 63, total threads: 0, pages: 1 [2,719.4Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 64, total threads: 0, pages: 1 [2,720.3Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 65, total threads: 0, pages: 1 [2,721.5Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 66, total threads: 0, pages: 1 [2,722.4Kb mem used] [0s (+0s)]
[SECTION START] showthread [2,723.1Kb mem used] [0s (+0s)]
[archive homepage] [2,758.5Kb mem used] [0s (+0s)]
[SECTION START] forumdisplay archived [2,759.1Kb mem used] [0s (+0s)]
[SECTION START] showthread archived [2,797.8Kb mem used] [0s (+0s)]
[SECTION START] member [2,812.6Kb mem used] [0s (+0s)]
[SECTION START] polls [2,814.2Kb mem used] [0s (+0s)]

Warning: gzopen(/home/forumy2/public_html/forum/vbseo_sitemap/data/sitemap_1.xml.gz) [function.gzopen]: failed to open stream: Permission denied in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 540

Warning: gzopen(/home/forumy2/public_html/forum/vbseo_sitemap/data/urllist.txt.gz) [function.gzopen]: failed to open stream: Permission denied in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 544

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 554

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 565

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 568

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 565

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 568

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 565

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 568

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 565

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 568

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 565

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 568

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 565

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 568

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 565

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 568

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 565

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 568

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 565

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 568

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 565

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 568

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 565

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 568

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 565

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 568

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 565

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 568

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 565

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 568

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 565

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 568

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 565

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 568

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 565

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 568

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 565

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 568

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 565

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 568

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 565

Warning: gzwrite(): supplied argument is not a valid stream resource in /home/forumy2/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 568


...


where am i doing false?


edit: i solve this problem through vbseo forums => data chmood777 ;)

iojam
06-27-2007, 03:56 PM
WarDoGG,
I tried manually adding the sitemap to "Google Webmaster Tools" but google says the sitemap cannot be found. Also, if i FTP to my root folder, i cant locate the sitemap_1.xml.gz file even though VBSEO says its been created.
you should create .htaccess file in your forums folder as described in installation instructions for that, and make sure that your host supports mod_rewrite.

unknownkind,
How will it upload to google automatically?
Sitemap will be re-generated automatically if you have a scheduled task setup in admincp as described.Also whats the point of have .htaccess? Is it needed?It's required to let your sitemaps "appear" like they are in the forums root, while files are stored in vbseo_sitemap/data/ folder.

djbaxter
06-27-2007, 04:37 PM
It's required to let your sitemaps "appear" like they are in the forums root, while files are stored in vbseo_sitemap/data/ folder.

Actually, that's no longer true if you use the new sitemaps declaration in the robots.txt file:

Sitemap: <sitemap_location>

where <sitemap_location> is the complete URL of your Sitemap Index File (or your sitemap file, if you don't have an index file). This directive is independent of the user-agent. so as long as it is present in the robots.txt file, all engines will be able to find your sitemaps. I see this as an important extension to the protocol, as it removes the need to individually submit sitemaps to each engine - simply add one line to your robots.txt file, and we will find your new and updated sitemaps automatically.

You might bear this in mind for a next version of this add-on.

Ohiosweetheart
06-28-2007, 04:01 AM
Why do I get 404 errors on my forum and in ACP after I've uploaded the .htaccess file?

Steve St.Lauren
06-28-2007, 04:43 PM
There looks to be an error in the import xml script. When I tried to import the product I got the following error:

Database error in vBulletin 3.6.7:

Invalid SQL:

UPDATE cron
SET nextrun = 1183258740
WHERE cronid = 20 AND nextrun =;

MySQL Error : You have an error in your SQL syntax. Check the manual that corresponds to your MySQL server version for the right syntax to use near '' at line 3
Error Number : 1064
Date : Thursday, June 28th 2007 @ 01:34:01 PM
Script : http://www.turbodieselregister.com/forums/admincp/plugin.php?do=productimport
Referrer : http://www.turbodieselregister.com/forums/admincp/plugin.php?do=productadd
IP Address : ##.##.##.##
Username : ##############
Classname : vb_database_slave


When I look at the import xml script in the cron section here is what is in there:

<phrase name="task_vbseo_sitemap_desc" date="1151544207" username="Juan Muriente" version="2.0"><![CDATA[Execute vBSEO Sitemap Generator]]></phrase>
<phrase name="task_vbseo_sitemap_log" date="1151544207" username="Juan Muriente" version="2.0" />
<phrase name="task_vbseo_sitemap_title" date="1151544207" username="Juan Muriente" version="2.0"><![CDATA[vBSEO Sitemap Generator]]></phrase>


It looks like the task_vbseo_sitemap_log entry is missing stuff - there's no /phrase and nothing to be added.

At the top of the screen I get this:

Warning: Invalid argument supplied for foreach() in /includes/functions_cron.php on line 95

miloheckport
06-28-2007, 06:13 PM
I was skeptical but VBSEO has increased our traffic, thread count, posts 3 fold since installing VBSEO - so stoked more people are discovering our site
http://discussion.socalskateparks.com

Ohiosweetheart
06-28-2007, 06:55 PM
Why do I get 404 errors on my forum and in ACP after I've uploaded the .htaccess file?

anyone have any ideas??

Steve St.Lauren
06-28-2007, 08:13 PM
My guess would be that you already had an .htaccess file for vBSEO in your forums directory and you overwrote it with the .htaccess file in the vbSEO sitemap distribution. The instructions tell you that if you already have an .htaccess file (which everyone that's already running vBSEO should) then you need to just add 3 lines to the very bottom of it. Here's the note from the installation docs:

Note: If you already have an .htaccess file in your forum root, DO NOT upload the vBSEO Google/Yahoo Sitemap .htaccess file as it will replace the contents of this file. Instead, enter the following code in your 'forum-root/.htaccess' file at the bottom:


RewriteEngine On
RewriteRule ^((urllist|sitemap).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]

Ohiosweetheart
06-28-2007, 08:57 PM
I know Steve, I read the instructions.

Problem is, I didn't overwrite any existing .htaccess file because I didn't have an .htaccess file in my forum root, and still don't, since I had to remove the one I uploaded from the zip here for my forum to work again.

I also don't run vBSEO on this forum. :)

Anyone have any other ideas?

iojam
06-29-2007, 02:03 PM
djbaxter,

Actually, that's no longer true if you use the new sitemaps declaration in the robots.txt file:Mm.. what exactly is not true from what I wrote above?
You can specify sitemap in robots.txt, you can submit it to Google webmaster account (to be able to track it) or just send a ping, but sitemap still should be located in the topmost folder. That's why .htaccess entry is required in case if files are stored in a subfolder.

Steve St.Lauren,

please try to uninstall xml product file and reinstall it.

Ohiosweetheart,

please make sure that your host supports mod_rewrite and allows rewrite rules in .htaccess.

Ohiosweetheart
06-29-2007, 02:27 PM
Ohiosweetheart,
please make sure that your host supports mod_rewrite and allows rewrite rules in .htaccess.
I know they allow mod_rewrite, because I have vBSEO on my other site which is on the same host, and have the instructed rewrite in that .htaccess file.

djbaxter
06-29-2007, 02:39 PM
djbaxter,

djbaxter,

Actually, that's no longer true if you use the new sitemaps declaration in the robots.txt file

Mm.. what exactly is not true from what I wrote above?
You can specify sitemap in robots.txt, you can submit it to Google webmaster account (to be able to track it) or just send a ping, but sitemap still should be located in the topmost folder. That's why .htaccess entry is required in case if files are stored in a subfolder.


^^^ THAT is what's not true. You can now locate the sitemap file wherever you wish as long as you specifiy the alternate location in the robots.txt file - the robots.txt file must reside in the root folder; the sitemap can be anywhere you like. If you do that, you don't need the mod_rewrite addition to your .htaccess file.

See http://www.sitemaps.org/protocol.php#submit_robots

Steve St.Lauren
06-29-2007, 03:01 PM
djbaxter,

Steve St.Lauren,

please try to uninstall xml product file and reinstall it.


I did and got the same message. I jut removed the cron portion out of the xml file and added the cron job manually. This was on 3.6.7 btw.

LewisAinslie
06-29-2007, 04:09 PM
I already have a .htaccess file. What do i do if i have one? add it to bottom?

djbaxter
06-29-2007, 04:54 PM
I already have a .htaccess file. What do i do if i have one? add it to bottom?

Yes, probably. You need a slight modification if you already have a mod_rewrite instruction in there.

If you see any lines like this:

Options +FollowSymLinks
RewriteEngine On

Add the RewrteRule line AFTER that.

RewriteRule ^(sitemap.*\.(xml\.gz|txt))$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1

Make sure that ONLY the last RewiteRule statement ends with the following:

[R=301,L]

For example, a site that contains two RewriteRule statements would look something like this:

Options +FollowSymLinks
RewriteEngine On
RewriteRule ^(sitemap.*\.(xml\.gz|txt))$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1
RewriteCond %{THE_REQUEST} ^[A-Z]{3,9}\ somesite.com
RewriteRule .* http://someothersite.com/? [R=301,L]

LewisAinslie
06-29-2007, 06:05 PM
Ok thanks but it is not writing the links as SEO, i have zoints SEO installed and its working for example
http://community.gamerjuice.co.uk/premium-membership-t64.html

but its writing to the site map as

http://community.gamerjuice.co.uk/showthread.php?t=64

da420
06-29-2007, 07:24 PM
Turn off mod_rewrite on the Zoints modification.

iojam
07-01-2007, 10:44 PM
Ohiosweetheart,

please try to add "RewriteBase /forums/" line to your .htaccess (replace /forums/ with your folder name).

djbaxter,
You can now locate the sitemap file wherever you wish as long as you specifiy the alternate location in the robots.txt fileAs it is said in the sitemap protocol (the page you have linked to):
The location of a Sitemap file determines the set of URLs that can be included in that Sitemap. A Sitemap file located at http://example.com/catalog/sitemap.xml can include any URLs starting with http://example.com/catalog/ but can not include URLs starting with http://example.com/images/.
And couldn't find a mention that sitemap can be located anywhere in case of robots.txt usage.

Mecho
07-06-2007, 09:22 AM
Hi ,

i have 3 questions :
1 - i have 102,142 Links and it takes 450.17 s !! i think it s not normal . is there anyway that we can set when seo is active forum will be close ?? something like that ?

2 - before i had all Sitemaps in my forum directory , but now they r only in /forum/vbseo_sitemap/data/ ! and i can not locate the last one in Google webmaster page . i did wrong somewhere ??

3 - when i want to Active HOT LINK PROTECTION i get this error : Apache detected an error in the Rewrite config.

Syntax error on line 12 of /home/public_html/.htaccess.aBB5r2n0IFH0udJZ1rinBr6RsFDCR5zV:
RewriteRule: cannot compile regular expression '.*\.(sitemap.*\.(xml\.gz|txt)$'
Please try again.

is it about SEO ? or what ?

thanks in advance

iojam
07-06-2007, 10:17 AM
Hello,

1. it is suggested to set the execution time for scheduled task to the moment with minimal activity on your forums

2. you should create .htaccess file as described, the files will still be saved in data/ folder, but you will be able to access them in forums root

3. what is your complete .htaccess file contents?

Yellow Slider
07-06-2007, 04:52 PM
I'm getting a blank page when running the script, i've just moved to a new server,
the PHP limit time to run scripts is 1000 Sec'
what can i do? i really need it back..

I've been using it for a year now..
what to do?

iojam
07-06-2007, 06:33 PM
Hello,

do you get any details in server's error log?

Yellow Slider
07-06-2007, 06:44 PM
no there isn't any thing in the server error log..

Mecho
07-06-2007, 07:10 PM
Hello,

1. it is suggested to set the execution time for scheduled task to the moment with minimal activity on your forums

2. you should create .htaccess file as described, the files will still be saved in data/ folder, but you will be able to access them in forums root

3. what is your complete .htaccess file contents?

about #1 : i found the option in setting : " Delay Execution After Each Sitemap File " but what amount u should suggest me ? is it second or minute or what ? ( default is 0 )

about #2 i : saw that my .htaccess is not available in forum directory !! so i made it again and now it works well .

about #3 :
my site is redirect from public_html to public_html/forum . so i have just one .htaccess in /forum directory and this is is :
RewriteEngine On
RewriteRule ^(sitemap.*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]


is it correct ? or i should have it in root directory too ? thanks

Yellow Slider
07-06-2007, 07:20 PM
I've fixed the problem, now i have a new problem, in the past i've used vBSEO, it isn;t installed now.
when i'm submitting my sitemaps to google they return errors after downloading the sitemaps -

HTTP Error:
URL:
URL:
URL:
URL:
URL:
Date found: 301 (Moved permanently) [?]
http://www.atraf-f.net/2036039-post12.html
http://www.atraf-f.net/1993365-post23.html
http://www.atraf-f.net/1870981-post55.html
http://www.atraf-f.net/1924662-post12.html
http://www.atraf-f.net/1959712-post6.html
Jun 11, 2007

URLs not followed
When we tested a sample of the URLs from your Sitemap, we found that some URLs were not accessible to Googlebot because they contained too many redirects. Please change the URLs in your Sitemap that redirect and replace them with the destination URL (the redirect target). All valid URLs will still be submitted. [?]

what is this? i don't have any "1959712-post6.html" in my forum..

I also have it -
rrors
General HTTP error: 404 not found
We encountered an error while trying to access your Sitemap. Please ensure your Sitemap follows our guidelines and can be accessed at the location you provided and then resubmit. [?] HTTP Error:
Date found: 404 (Not found) [?]
Jul 6, 2007

but when i'm trying to access the sitemaps it's working ..

but some do work..
sitemap_142.xml.gz Sitemap Web Apr 2, 2007 7 hours ago OK 10000

iojam
07-08-2007, 02:08 PM
Mecho,

1. that depends on how is your server load affected. You can try to set it to 20-30 seconds.
3. yes, this is correct.

Mecho
07-08-2007, 03:05 PM
Thanks iojam

T_Richardson
07-08-2007, 11:06 PM
I got 12 errors in the google sitemap webmaster tools:

Line: 8
Paths don't match
We've detected that you submitted your Sitemap using a URL path that includes the www prefix (for instance, http://www.example.com/sitemap.xml). However, the URLs listed inside your Sitemap don't use the www prefix (for instance, http://example.com/myfile.htm). [?] URL: http://alliedterritory.com/
Date found: Jul 8, 2007

TCB
07-09-2007, 04:29 PM
you need to fix the cpnav_vbseo_sitemap.xml in there you will see <navgroup phrase="vbseo" displayorder="3"> it should be <navgroup phrase="vbseo_vbseo" displayorder="3"> if not it will show the incorrect phrase ( *[vbseo]* ) in admincp.

Thanks :D

that really annoyed me, it looks way better now

iojam
07-09-2007, 09:47 PM
T_Richardson,

in case if your forums URL is defined in admincp like http://example.com, you should submit sitemap like http://example.com/sitemap.xml (NOT http://www.example.com/sitemap.xml).

Yellow Slider
07-10-2007, 06:36 PM
the sitemap tool is working for a year on my board..
but, Google like to index pages from my board that are really old, and i don't want google bots to access those pages, which means that i shouldn't send google in the sitemaps old URLs..
I have just one google bot on the site, it is the same bot that is downloading all the sitemaps, and it his crawling my board a lot, so I want it to crawl new threads , what do I need to change to Generate filtered sitemaps (which means that only threads from a certain date will be included in the site maps files) can you please help me?

iojam
07-11-2007, 10:12 PM
vBSEO Sitemap Generator doesn't allow to exclude (cutoff) the threads based on the posts age.

Boots
07-16-2007, 03:03 PM
Should I see an entry for every single day in my "Show Reports List" ? I only have 3 entries there and this has been installed for 6 days.

Boots
07-16-2007, 03:19 PM
Here is my scheduled task log for the job


6100 vbseo_sitemap_task 03:01, 16th Jul 2007 Google Sitemap [Started]
6081 vbseo_sitemap_task 03:02, 15th Jul 2007 Google Sitemap [Started]
6057 vbseo_sitemap_task 03:01, 14th Jul 2007 Google Sitemap [Started]
6035 vbseo_sitemap_task 03:02, 13th Jul 2007 Google Sitemap [Started]
6016 vbseo_sitemap_task 03:00, 12th Jul 2007 Google Sitemap [Started]
5991 vbseo_sitemap_task 03:00, 11th Jul 2007 Google Sitemap [Started]
5972 vbseo_sitemap_task 03:01, 10th Jul 2007 Google Sitemap [Started]
5973 vbseo_sitemap_task 03:01, 10th Jul 2007 Google Sitemap Created
5956 vbseo_sitemap_task 15:28, 9th Jul 2007 Google Sitemap [Started]
5957 vbseo_sitemap_task 15:28, 9th Jul 2007 Google Sitemap Created

iojam
07-17-2007, 10:29 PM
Hello,

try to execute sitemap generation manually in vbseo_sitemap/ interface to check if it finishes successfully.

Boots
07-17-2007, 11:25 PM
It executes fine when run manually.

Bacon Butty
07-18-2007, 09:41 AM
Newbie alert here lads.

I installed the mod a while ago, but when I go to googles webmaster tools I am getting an error when I try to add the sitemap.

I have tried forum/sitemap_index.xml.gz and /sitemap_index.xml.gz but it isn't accepting it?

When I check in the FTP there is no such file as 'sitemap_index.xml.gz' How do I generate it? I have run the sitemap generator I get;

[homepage] [0s (+0)]
[SECTION START] forumdisplay [0s (+0)]
[forumdisplay] forum_id: 1, total threads: 0, pages: 1 [0s (+0)]
[forumdisplay] forum_id: 2, total threads: 446, pages: 23 [0s (+0)]
[forumdisplay] forum_id: 6, total threads: 103, pages: 6 [0s (+0)]
[forumdisplay] forum_id: 3, total threads: 577, pages: 29 [0s (+0)]
[forumdisplay] forum_id: 4, total threads: 215, pages: 11 [0s (+0)]
[forumdisplay] forum_id: 14, total threads: 0, pages: 1 [0s (+0)]
[forumdisplay] forum_id: 15, total threads: 1, pages: 1 [0s (+0)]
[forumdisplay] forum_id: 17, total threads: 1, pages: 1 [0s (+0)]
[forumdisplay] forum_id: 16, total threads: 4, pages: 1 [0s (+0)]
[forumdisplay] forum_id: 18, total threads: 0, pages: 1 [0s (+0)]
[forumdisplay] forum_id: 11, total threads: 73, pages: 4 [0s (+0)]
[SECTION START] showthread [0s (+0)]
[create sitemap file] filename: sitemap_1.xml.gz, number of urls: 20000 [1s (+1)]
[create sitemap in text format] part #2 [1s (+0)]
[archive homepage] [2s (+0)]
[SECTION START] forumdisplay archived [2s (+0)]
[SECTION START] showthread archived [2s (+0)]
[SECTION START] member [2s (+0)]
[create sitemap file] filename: sitemap_2.xml.gz, number of urls: 6966 [2s (+0)]
[create sitemap in text format] part #3 [2s (+0)]
[create sitemap index] filename: sitemap_index.xml.gz, number of sitemaps: 2 [2s (+0)]

Any help greatly appreciated.