vb.org Archive - Administrative and Maintenance Tools - vBSEO Google/Yahoo Sitemap Generator

vb.org Archive (https://vborg.vbsupport.ru/index.php)

- vBulletin 3.6 Add-ons (https://vborg.vbsupport.ru/forumdisplay.php?f=194)

- - Administrative and Maintenance Tools - vBSEO Google/Yahoo Sitemap Generator (https://vborg.vbsupport.ru/showthread.php?t=144730)

Quick question, in the install docs it says to upload the .htaccess file.

Do you just upload the single .htaccess file OR the whole htaccess folder?

The folder contains other files, if I just upload the one .htaccess file, these other files won't get uploaded.

Thanks!..

Just the .htaccess file. The other files are readme files only.

But read the posts just above yours: If you already have an .htaccess file, you want to ADD the lines from the add-on .htaccess file to the bottom of the existinfg .htaccess file so you do not overwrite what's already there.

Has anyone managed to get this to work on a GoDaddy hosted site?

I have tried everything that I have found on this post to try to fix this. 1st No matter what I put in the Sitemap Files URL field, i get 404'd when i try to access them. I have tried every different permission combination that I could and nothing. I have moved the files and moved them back. Still nothing. My HTACCESS file is exactly as it should be. Google reports same thing 404 not found no matter where i place the files. **screams** I need help!

Thanks:eek:

Quote:

Originally Posted by mlomenzo (Post 1271828)

I have exactly the same problem and after bugging vbSEO on there forum they finally admitted that unless your host allows PHP files to be used via the mod_rewrite then it won't work.

Often hosts allow mod_rewrite, but NOT for PHP files (GoDaddy for one).

The staff at vbSEO wasted my time saying 'do this' and 'do that' when surely they know that it doesn't work with GoDaddy.

Really disappointed with them, won't be ordering vbSEO now.

i just cant get the prick to work lol.

My sitemap has generated

Quote:

Total URLs 17,226 (+322)
Forumdisplay URLs 214 (+6)
Showthread URLs 3,203 (+57)
ShowPost URLs 10,833 (+198)

in the past 1 month. . but it doesnt show any bots download activity.

I tried manually adding the sitemap to "Google Webmaster Tools" but google says the sitemap cannot be found. Also, if i FTP to my root folder, i cant locate the sitemap_1.xml.gz file even though VBSEO says its been created.

I get this error while submitting to google manually :

Quote:

General HTTP error: 404 not found
We encountered an error while trying to access your Sitemap. Please ensure your Sitemap follows our guidelines and can be accessed at the location you provided and then resubmit.

I dont understand the .gz format, because i think Google requires sitemaps in XML format ?

.gz is gzip, a compressed file format. Google is fine with that

Okay I have a few questions and hopefully someone can explain them to me....

I installed this hack fine and everything seems to be working fine or at least I hope so...
My site map is located at http://www.mysite.net/forums/sitemap_index.xml.gz. I added a robots.txt and put inside http://www.mysite.net/forums/sitemap_index.xml.gz. Well I went to google add my sitemap and put the link in and it loaded.. How will it upload to google automatically? Also whats the point of have .htaccess? Is it needed? Is robots.txt needed or should I get rid of it..? In the vBSEO settings theres a spot for your "Yahoo ID", but I thought this hack doesn't auto upload to yahoo? Whats the point of having the ID?

Quote:

The Yahoo sitemap must be manually submitted to http://submit.search.yahoo.com/free/request/.

I saw someone put this for his robots.txt

Code:

User-agent: *

Disallow: /ajax.php

Disallow: /attachment.php

Disallow: /cron.php

Disallow: /editpost.php

Disallow: /image.php

Disallow: /inlinemod.php

Disallow: /joinrequests.php

Disallow: /login.php

Disallow: /misc.php

Disallow: /moderator.php

Disallow: /newattachment.php

Disallow: /newreply.php

Disallow: /newthread.php

Disallow: /poll.php

Disallow: /postings.php

Disallow: /private.php

Disallow: /register.php

Disallow: /report.php

Disallow: /reputation.php

Disallow: /search.php

Disallow: /sendmessage.php

Disallow: /showgroups.php

Disallow: /subscription.php

Disallow: /threadrate.php

Disallow: /usercp.php

Disallow: /usernote.php



Sitemap: http://www.mysite.net/forums/sitemap_index.xml.gz

Is all that necessary or do I just need the Sitemap: http://www. etc..........

Thanks for the much needed help!

--UnknownKind

Hopefully this also clears up the same problems other people are having....

Very nice work! Can't wait to see the results! But I have a couple problems...

My website is running vBulletin in a /forums/ folder (ex: http://www.domain.com/forums/) and I have a normal website in my root (not vBadvanced or some other portal). I added my root website to the extra-urls.txt in hopes that it will be added to the sitemap. I also set my root as the Sitemap URL, expecting the sitemaps (or atleast the sitemap index) to be generated in my root (http://www.domain.com/sitemap_index.xml.gz).

Problem part::
I just ran the scheduled task to see if it would generate a new sitemap index in the root and no dice. It didn't even generate it in the default vBulletin directory (/forums/). The only place that it is stored is http://www.domain.com/forums/vbseo_s...p_index.xml.gz.
And now I just got a few errors in my log complaining that there was no file http://www.domain.com/vbseo_sitemap/...getsitemap.php (no /forums/).

So anyone know what's going on?

The problem was that I had to include "forums/" in the .htaccess instead of just "vbseo_sitemap/..." which I didn't realize until I actually took a look at it :D

But I have another bit... I only want Google and Yahoo! to use the archive, so I disabled use of showthread, showpost, member profiles, etc. and only let the sitemaps include the archive. The reason is that I think that search engines can focus more on the content than menu/other links and plus, Yahoo! Slurps have been creating some decent server load, so I think that it might be better with no advanced GUI. Is this a good idea or not?

And a new problem:

Now that spiders are crawling my archive, some of them are not taking the archive/index.php/ as a directory. I'm getting error logs like "File not found: /forums/archive/f-86.html." I don't want to have to edit the archiving script to include index.php/ in front of every one of its links. I'd much rather use a .htaccess type of thing. Does anyone know how I could do the following in .htaccess?

Redirect anything trying to get a *.html file in the /archive/ directory TO /archive/index.php/%filename%

(Where %filename% is the *.html file that the client was trying to get)

Anyone? :)

X vBulletin 3.8.12 by vBS Debug Information
Template Usage: (1)ad_footer_end (1)ad_footer_start (1)ad_header_end (1)ad_header_logo (1)ad_navbar_below (1)bbcode_code_printable (4)bbcode_quote_printable (1)footer (1)gobutton (1)header (1)headinclude (6)option (1)pagenav (1)pagenav_curpage (4)pagenav_pagelink (3)pagenav_pagelinkrel (1)post_thanks_navbar_search (1)printthread (10)printthreadbit (1)spacer_close (1)spacer_open Phrase Groups Available: global postbit showthread	Included Files: ./printthread.php ./global.php ./includes/init.php ./includes/class_core.php ./includes/config.php ./includes/functions.php ./includes/class_hook.php ./includes/modsystem_functions.php ./includes/class_bbcode_alt.php ./includes/class_bbcode.php ./includes/functions_bigthree.php Hooks Called: init_startup init_startup_session_setup_start init_startup_session_setup_complete cache_permissions fetch_threadinfo_query fetch_threadinfo fetch_foruminfo style_fetch cache_templates global_start parse_templates global_setup_complete printthread_start pagenav_page pagenav_complete bbcode_fetch_tags bbcode_create bbcode_parse_start bbcode_parse_complete_precache bbcode_parse_complete printthread_post printthread_complete
Messages:

Phrase Groups Available:

X vBulletin 3.8.12 by vBS Debug Information
Page Generation 0.05502 seconds Memory Usage 1,758KB Queries Executed 10 (?)
More Information
Template Usage: (1)ad_footer_end (1)ad_footer_start (1)ad_header_end (1)ad_header_logo (1)ad_navbar_below (1)bbcode_code_printable (4)bbcode_quote_printable (1)footer (1)gobutton (1)header (1)headinclude (6)option (1)pagenav (1)pagenav_curpage (4)pagenav_pagelink (3)pagenav_pagelinkrel (1)post_thanks_navbar_search (1)printthread (10)printthreadbit (1)spacer_close (1)spacer_open Phrase Groups Available: global postbit showthread	Included Files: ./printthread.php ./global.php ./includes/init.php ./includes/class_core.php ./includes/config.php ./includes/functions.php ./includes/class_hook.php ./includes/modsystem_functions.php ./includes/class_bbcode_alt.php ./includes/class_bbcode.php ./includes/functions_bigthree.php Hooks Called: init_startup init_startup_session_setup_start init_startup_session_setup_complete cache_permissions fetch_threadinfo_query fetch_threadinfo fetch_foruminfo style_fetch cache_templates global_start parse_templates global_setup_complete printthread_start pagenav_page pagenav_complete bbcode_fetch_tags bbcode_create bbcode_parse_start bbcode_parse_complete_precache bbcode_parse_complete printthread_post printthread_complete
Messages: