vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vBulletin 3.8 Add-ons (https://vborg.vbsupport.ru/forumdisplay.php?f=235)
-   -   Administrative and Maintenance Tools - vBSEO Google/Yahoo Sitemap Generator (https://vborg.vbsupport.ru/showthread.php?t=206169)

AfterWorldForum 09-16-2009 04:25 AM

Hey,

Installed and ran it for a few days, and have been keeping an eye on my WebMaster tools to see how effective this is. I just see a major difference between total urls and Indexed urls:

Format URLs in Sitemap Submitted Downloaded
Sitemap Index Total: 791, Indexed: 19

Sep 15, 2009 ? Resubmit Sep 15, 2009
Sitemap errors and warnings


Could anyone explain the difference between the two? How can I get more indexed urls of the total amount?

I still have to update my robots etc, and do some other standard seo tweaking, but was just curious about the huge difference between these two.

Thanks in advance :)

Peter

Chimpie 09-24-2009 05:01 PM

A client of mine has developed an interesting situation that I can't figure out.

If I go under vBSEO Sitemap Reports, and run the generator I get this...
Quote:

[homepage] [3,089.1Kb mem used] [0s (+0s)]
[SECTION START] forumdisplay [3,089.4Kb mem used] [0s (+0s)]
[SECTION START] showthread [3,089.6Kb mem used] [0s (+0s)]
[archive homepage] [3,089.8Kb mem used] [0s (+0s)]
[SECTION START] forumdisplay archived [3,089.9Kb mem used] [0s (+0s)]
[SECTION START] showthread archived [3,090.0Kb mem used] [0s (+0s)]
[SECTION START] member [3,090.1Kb mem used] [0s (+0s)]
[SECTION START] polls [3,096.3Kb mem used] [0s (+0s)]
[SECTION START] blogs [3,096.3Kb mem used] [0s (+0s)]
[SECTION START] albums [3,096.3Kb mem used] [0s (+0s)]
[SECTION START] groups [3,096.4Kb mem used] [0s (+0s)]
[SECTION START] tags [3,102.8Kb mem used] [0s (+0s)]
Database errorThe The forum name edit database has encountered a problem.
But if I go under the Scheduled Tasks and run it, it goes through just fine, even sending me the confirmation email.

Everything was working just fine, for about 13 days, then during the scheduled task it would cause an error. Then it worked for one day after, then errors out again.

I have uninstalled the xml file and reinstalled, overwriting... no help.
I reuploaded and overrode the install files... no help.

I've turned off all the other mods and hacks... no help.

I'm really confused on this one.

donnie_ogm 10-03-2009 07:37 AM

Hi guys,

are there any codes to be inserted in .htaccess in order to try to have html link in the sitemaps?

Thanks in advance

blackberry 10-03-2009 09:42 PM

its not working for me

whenever i click on run sitemap generator

its gives me this error

any fix will be appreciated thanks

Quote:

[SECTION START] tags [12,798.6Kb mem used] [5,405,634s (+191s)]
[create sitemap file] filename: sitemap_239.xml.gz, number of urls: 20000 [12,862.4Kb mem used] [5,405,644s (+10s)]
[create sitemap in text format] part #240 [12,862.4Kb mem used] [5,405,644s (+0s)]
[create sitemap file] filename: sitemap_240.xml.gz, number of urls: 20000 [12,865.6Kb mem used] [5,405,659s (+15s)]
[create sitemap in text format] part #241 [12,865.7Kb mem used] [5,405,659s (+0s)]
[create sitemap file] filename: sitemap_241.xml.gz, number of urls: 20000 [12,868.3Kb mem used] [5,405,677s (+18s)]
[create sitemap in text format] part #242 [12,868.3Kb mem used] [5,405,677s (+0s)]
[create sitemap file] filename: sitemap_242.xml.gz, number of urls: 20000 [12,869.8Kb mem used] [5,405,696s (+20s)]
[create sitemap in text format] part #243 [12,869.8Kb mem used] [5,405,696s (+0s)]
[create sitemap file] filename: sitemap_243.xml.gz, number of urls: 2982 [12,866.3Kb mem used] [5,405,700s (+3s)]
[create sitemap in text format] part #244 [12,866.3Kb mem used] [5,405,700s (+0s)]
[create sitemap index] filename: sitemap_index.xml.gz, number of sitemaps: 243 [12,926.6Kb mem used] [5,405,700s (+0s)]

Fatal error: Allowed memory size of 67108864 bytes exhausted (tried to allocate 252049792 bytes) in /h****/sa****/p****/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 1537

kall 10-03-2009 09:59 PM

Quote:

Originally Posted by blackberry (Post 1894373)
its not working for me

whenever i click on run sitemap generator

its gives me this error

any fix will be appreciated thanks

Either just keep running it (it will pick up where it left off), or increase your memory_limit.

blackberry 10-04-2009 02:48 PM

how to increase memory_limit?

Cloudrunner 10-04-2009 04:05 PM

Quote:

Originally Posted by blackberry (Post 1894373)
its not working for me

whenever i click on run sitemap generator

its gives me this error

any fix will be appreciated thanks

Increase your wait time between file making to 30, increase your total links per file to 40,000. Doing these *should* lower your memory usage. I am not a dev for this mod, so I could be wrong. These have helped me though.

Sitemap Settings -> Max URLs in Sitemap Files -> 40000
Sitemap Settings -> Delay Execution After Each Sitemap File -> 30

Also take a read on the following posts, because it looks to me like you are pushing entirely too much data to the engines (243 site files? Really?):

The original post can be found here with even more SEO information

Quote:

Originally Posted by Biransol's Ultimate Guide to vBSEO
In the sitemap, think lean. All you want is your main info. No bloat. The idea is not to index every little bit.. it's to index your important info. If you have more than 4 or 5 files per million posts, you're doing it wrong. I can't tell you how many times i've seen sub-million post forums with 70-odd sitemap files. Doing that is entirely counter productive. I recommend the following settings:
http://www.vbseo.com/attachments/f2/...ap_options.jpg

There is a problem introduced when you change your priorities to what Briansol has though (Sitemap will write the priorities wrong and mess up a tag within the sitemap causing google to get upset), so to avoid the issue I suggestion the following priorities (they meld with Briansol's, but avoid the issue that is introduced when using his priority settings):

Smart Frequency for Show Thread Pages: Yes
Priority Range - Show Post: 0.1-0.2
Priority Range - Member Profiles: 0.2-0.3
Priority Range - Forum Display: 0.6-0.7
Priority Range - Poll Results: 0.1-0.2
Priority Range - Show Thread: 0.9-1.0
Priority Range - Blog Entries: 0.2-0.3
Priority Range - Blog Tags: 0.2-0.3
Priority Range - Member Profile Albums: 0.2-0.3
Priority Range - Social Groups:0.3-0.4
Priority Range - Social Group Discussions: 0.3-0.4
Priority Range - Social Group Pictures: 0.3-0.4
Priority Range - Tags: 0.5-0.6
Smart Priority: Yes

Seriously, knock out a bunch of them links (most of which I'm sure are useless to you in terms of quality content in the eyes of the all seeing, all knowing Google) out of your sitemap and not only will you see a more efficient crawl from the spiders, but since they have an easier time crawling the most important stuff, they then will have more time to spread out within your site and consume the other bits and you'll quit overloading your server's memory :D.

blackberry 10-04-2009 06:50 PM

@cloudrunner

as per ur settings i finally get this

Thanks alot

Quote:

[SECTION START] tags [11,545.9Kb mem used] [5,481,734s (+486s)]
[create sitemap file] filename: sitemap_287.xml.gz, number of urls: 40000 [11,598.7Kb mem used] [5,481,794s (+60s)]
[create sitemap file] filename: sitemap_288.xml.gz, number of urls: 1555 [11,594.7Kb mem used] [5,481,827s (+33s)]
[create sitemap index] filename: sitemap_index.xml.gz, number of sitemaps: 288 [11,665.8Kb mem used] [5,481,827s (+0s)]
Sitemap has been created. Click here to return [11,559.8Kb mem used] [5,481,828s (+1s)]

Cloudrunner 10-04-2009 08:22 PM

Anytime my friend, I'm glad I could help :D.

Jeez, how long has your site been running LOL? 288 pages ... wow ... that's insane!

MagicThemeParks 10-04-2009 09:48 PM

Just had the Live.com ping fail.

Quote:

Live.com ping: FAILED
....what did I miss or what do I need to fix?


All times are GMT. The time now is 08:57 AM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.02358 seconds
  • Memory Usage 1,757KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (7)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (4)pagenav_pagelink
  • (2)pagenav_pagelinkrel
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (10)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete