vb.org Archive - vBSEO Google/Yahoo Sitemap Generator for vBulletin 3.6.x, 3.5.x & 3.0.x

So, ever since posting about how great this mod was google has not successfully crawled the sitemaps. keep getting th 5XX error about robots.txt being unreachable. Haven't changed a thing and it was working fine.

The google sitemaps page shows the sitemap_index.xml.gz was last downloaded 4 hours ago but the Sitemap Downloads Log within the mod inself hasn't show any activity in days. There is no activity from yahoo either.

4yBak

06-28-2006 06:50 AM

Quote:

Generate Yahoo-Compatible Text Sitemap
Select "Yes" to automatically generate a text format sitemap with 1 URL per line. This text sitemap must be manually submitted to Yahoo at http://submit.search.yahoo.com/free/request/.

how submit URL to Yahoo? What url must be input at Yahoo?

I input this value - http://yourforumurl/sitemap.txt.gz

Is it true?

Quote:

The google sitemaps page shows the sitemap_index.xml.gz was last downloaded 4 hours ago but the Sitemap Downloads Log within the mod inself hasn't show any activity in days. There is no activity from yahoo either.

same problem, google start download sitemap 11 days ago, and yahoo - no activity.

iojam

06-28-2006 04:29 PM

4yBak,

Quote:

how submit URL to Yahoo? What url must be input at Yahoo?

I input this value - http://yourforumurl/sitemap.txt.gz

Yes, this is correct. The next version of vBSEO Sitemap Generator will change the filename to urllist.txt.gz though.

4yBak, slo_chewie,

Quote:

same problem, google start download sitemap 11 days ago, and yahoo - no activity.

Are you using vBSEO2.2.1+ product (it's not the same as vBSEO Sitemap Generator)? It is required for SE bots activity logging, as it is specified in the vbseo_sitemap/ interface.

Guest210212002

06-29-2006 12:03 AM

Apologies if this has been answered, I tried searching on "directory" and didn't see it.

My script runs just fine, but if try grabbing any of the xml.gz files from the Sitemap Reports homepage, the links are formatted as:

mydomain.tld/report_x.xml.gz

Where they should be:

mydomain.tld/vbseo_sitemap/data/report_x.xml.gz

Where is the setting that I need to edit so that these links are correct? My data dir is chmod 777.

Thanks in advance and apologies again if it's been said, I'll keep looking in the meantime.

ConqSoft

06-29-2006 01:11 AM

The .htaccess file makes them appear as if they are in your forum root, so that the first link you posted will work. The files must appear to be in the forum root for them to be valid.

VBUsers

06-29-2006 01:41 AM

will this work with 3.6 beta 3?

4yBak

06-29-2006 12:24 PM

Quote:

Are you using vBSEO2.2.1+ product (it's not the same as vBSEO Sitemap Generator)? It is required for SE bots activity logging, as it is specified in the vbseo_sitemap/ interface.

no, I use only vBSEO Google/Yahoo Sitemap Generator. For seeing bots activity I use product Spider Watcher.

Guest210212002

06-29-2006 02:05 PM

Quote:

Originally Posted by ConqSoft

The .htaccess file makes them appear as if they are in your forum root, so that the first link you posted will work. The files must appear to be in the forum root for them to be valid.

Aah, gotcha regarding the .htaccess. I"m still getting 404's trying to download the .xml's though. My setup is that I have VBAdvanced in my web root, and my forums under /forum/. So the .htaccess goes in /forum/, correct?

[high]* Guest210212002 goes off to play some more[/high]

iojam

06-30-2006 02:18 AM

4yBak,
in this case you cannot track the SE bots hits in vbseo_sitemap.

Chris-777,
yes, put .htaccess file in the forums root folder.

Guest210212002

07-01-2006 11:35 AM

Quote:

Originally Posted by iojam

Chris-777,
yes, put .htaccess file in the forums root folder.

Got it working, thank you very much! I just forgot to add the /forum/ to my .htaccess file in the rewrite line. :)

All times are GMT. The time now is 03:35 AM.

Page 110 of 167

110

Show 40 post(s) from this thread on one page

X vBulletin 3.8.12 by vBS Debug Information
Page Generation 0.02818 seconds Memory Usage 1,745KB Queries Executed 10 (?)
More Information
Template Usage: (1)ad_footer_end (1)ad_footer_start (1)ad_header_end (1)ad_header_logo (1)ad_navbar_below (7)bbcode_quote_printable (1)footer (1)gobutton (1)header (1)headinclude (6)option (1)pagenav (1)pagenav_curpage (4)pagenav_pagelink (5)pagenav_pagelinkrel (1)post_thanks_navbar_search (1)printthread (10)printthreadbit (1)spacer_close (1)spacer_open Phrase Groups Available: global postbit showthread	Included Files: ./printthread.php ./global.php ./includes/init.php ./includes/class_core.php ./includes/config.php ./includes/functions.php ./includes/class_hook.php ./includes/modsystem_functions.php ./includes/class_bbcode_alt.php ./includes/class_bbcode.php ./includes/functions_bigthree.php Hooks Called: init_startup init_startup_session_setup_start init_startup_session_setup_complete cache_permissions fetch_threadinfo_query fetch_threadinfo fetch_foruminfo style_fetch cache_templates global_start parse_templates global_setup_complete printthread_start pagenav_page pagenav_complete bbcode_fetch_tags bbcode_create bbcode_parse_start bbcode_parse_complete_precache bbcode_parse_complete printthread_post printthread_complete
Messages: