Go Back   vb.org Archive > vBulletin Modifications > Archive > Modification Graveyard

Reply
 
Thread Tools
vB Global Translator - Multiply your indexed pages & put search traffic on autopilot Details »»
vB Global Translator - Multiply your indexed pages & put search traffic on autopilot
Version: 2.4, by Dave Hybrid Dave Hybrid is offline
Developer Last Online: Dec 2013 Show Printable Version Email this Page

Category: Miscellaneous Hacks - Version: 3.8.x Rating:
Released: 06-27-2009 Last Update: 07-07-2009 Installs: 67
Uses Plugins Template Edits
Additional Files  
No support by the author.

**Text Removed**

Show Your Support

  • This modification may not be copied, reproduced or published elsewhere without author's permission.

Comments
  #592  
Old 08-04-2009, 05:31 AM
imported_silkroad imported_silkroad is offline
 
Join Date: Dec 2003
Posts: 563
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

After working with this mod for three weeks, I have dropped the Google Sitemap method suggested by the vBSEO team. That method, well intended, was a quick "kludge" which was not optimal for this type of application.

What I have done is easy and requires a small bit of manual labor and goes something like this:
  1. Copy the *xml.gz files from ./vbseo_sitemap/data to another directory, for example FORUMROOT/es for Spanish, FORUMROOT/ja for Japanese, FORUMROOT/zh-CN for Chinese etc.
  2. Unzip the files and use sed to add the ?hl=ja (or whatever flag you want to do) to each URL in the Sitemap. This takes about 10 seconds.
  3. Update sitemap_index.xml.gz the same way, or use VI, etc.
  4. Submit this Sitemap to Google.
  5. Copy the first one you did and repeat for as many languages as you wish.

This method has many advantages.

First of all you have a completely different sitemap of your entire site for each language. So easy to submit to language specific search engines. Also, you can easily track the indexing progress for each Sitemap. This is much easier to manage and much cleaner, IMHO.

Of course, this method takes a bit of work when your need to update your language Sitemaps, but if you have a large board, this will get you indexed nicely in a well organized way. You can add the newer links after a high percentage of the legacy links are archived (in a few months).

We added the top 10 languages to Google Webmaster Tools, each with its own Sitemap, so where we originally had one big sitemap with nearly 396K URLs, we now have a total of around 4,750K URLs total in 11 Sitemaps. So far, Google is happy :-)

With this simple method, you can see the index progress on each language. You can submit your Sitemaps to language specific search engines. You can manage the update frequency on the translated URLs differently than your main site. You can also avoid any potential problems with your main sitemap.

(See attachment)

Enjoy and Good Luck!
Reply With Quote
  #593  
Old 08-04-2009, 05:49 AM
imported_silkroad imported_silkroad is offline
 
Join Date: Dec 2003
Posts: 563
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

I forgot to add, for the next "trick" I will write the URLs in the new Sitemaps as

Code:
FORUMROOT/flag/url.html
versus

Code:
FORUMROOT/url.html?hl=flag
etc....

and then add a very simple mod_rewrite rule to rewrite FORUMROOT/flags/blahblah.... to FORUMROOT/blahblah?hl=flag

:-)
Reply With Quote
  #594  
Old 08-04-2009, 05:57 AM
cyc cyc is offline
 
Join Date: Nov 2002
Posts: 48
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by imported_silkroad View Post
I forgot to add, for the next "trick" I will write the URLs in the new Sitemaps as

Code:
FORUMROOT/flag/url.html
versus

Code:
FORUMROOT/url.html?hl=flag
etc....

and then add a very simple mod_rewrite rule to rewrite FORUMROOT/flags/blahblah.... to FORUMROOT/blahblah?hl=flag

:-)
Great idea! keep in mind this will effect paths to css and images on some forums.
Reply With Quote
  #595  
Old 08-04-2009, 06:16 AM
imported_silkroad imported_silkroad is offline
 
Join Date: Dec 2003
Posts: 563
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Note:

We are definately seeing a sort of "Google penalty" for using ?hl=flag (duplicate content, it seems -- at least in the Sitemaps)

As Google indexes the various language sitemaps, it is subtracting indexed links from the main sitemap ... so I will need to rewrite the URLs sooner-than-later !
Reply With Quote
  #596  
Old 08-04-2009, 10:03 AM
NLP-er's Avatar
NLP-er NLP-er is offline
 
Join Date: Aug 2008
Location: Wrocław
Posts: 1,353
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by imported_silkroad View Post
Note:

We are definately seeing a sort of "Google penalty" for using ?hl=flag (duplicate content, it seems -- at least in the Sitemaps)

As Google indexes the various language sitemaps, it is subtracting indexed links from the main sitemap ... so I will need to rewrite the URLs sooner-than-later !
I think it was temporary Google problem - I change nothing and right now my sitemap is clear of duplicate content errors Just checked.
Reply With Quote
  #597  
Old 08-04-2009, 10:23 AM
imported_silkroad imported_silkroad is offline
 
Join Date: Dec 2003
Posts: 563
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

<font color="Red">EDIT: DOES NOT WORK YET. DO NOT USE THE 'BRAINSTORMING' IDEA HERE</font>. - imported_silkroad

Cheers NLP-er and Thanks.

I think we will vBSEO rewrite, something like:

'^(.+?)\.html\?hl=(.+?)$' => '$2/$1.html'

Do you think it this work?

Or maybe just manually change the sitmaps (as above #591) and try:

'^ja/(.+?)\.html$' => '$1.html?hl=ja'
'^ru/(.+?)\.html$' => '$1.html?hl=ru'
'^ko/(.+?)\.html$' => '$1.html?hl=ko'

yadda, yadda, yadda ..

Maybe?
Reply With Quote
  #598  
Old 08-04-2009, 03:03 PM
swerdlow swerdlow is offline
 
Join Date: May 2009
Posts: 1
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

just installed this...works great and easy setup too

thanks
Reply With Quote
  #599  
Old 08-04-2009, 04:08 PM
tpearl5's Avatar
tpearl5 tpearl5 is offline
 
Join Date: Nov 2001
Location: PA
Posts: 1,014
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by imported_silkroad View Post
Cheers NLP-er and Thanks.

I think we will vBSEO rewrite, something like:

'^(.+?)\.html\?hl=(.+?)$' => '$2/$1.html'

Do you think it this work?

Or maybe just manually change the sitmaps (as above #591) and try:

'^ja/(.+?)\.html$' => '$1.html?hl=ja'
'^ru/(.+?)\.html$' => '$1.html?hl=ru'
'^ko/(.+?)\.html$' => '$1.html?hl=ko'

yadda, yadda, yadda ..

Maybe?
Did you add this to your custom rewrite rules and custom redirects?
Reply With Quote
  #600  
Old 08-04-2009, 11:53 PM
NLP-er's Avatar
NLP-er NLP-er is offline
 
Join Date: Aug 2008
Location: Wrocław
Posts: 1,353
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by imported_silkroad View Post
Cheers NLP-er and Thanks.

I think we will vBSEO rewrite, something like:

'^(.+?)\.html\?hl=(.+?)$' => '$2/$1.html'

Do you think it this work?

Or maybe just manually change the sitmaps (as above #591) and try:

'^ja/(.+?)\.html$' => '$1.html?hl=ja'
'^ru/(.+?)\.html$' => '$1.html?hl=ru'
'^ko/(.+?)\.html$' => '$1.html?hl=ko'

yadda, yadda, yadda ..

Maybe?
I checked first one '^(.+?)\.html\?hl=(.+?)$' => '$2/$1.html' and it crashed my forum So I commented it.

The best way would be to redirect internally URLs like country/rest to rest?hl=country.
Internally I mean without changing URL in browser (without sending header).
And redirect URLs like rest?hl=country to country/rest with 301 header.

It would be best because old, already indexed addresses will work. Redirect will made reindexing faster (I think ) and you avoid possibility of duplicate content penalty if same content is available in booth URL's. In same time it would be good for this mod because no changes would be required at all. Unfortunately I'm not expert in .htaccess file or vbSEO custom rewrite rules, so I don't know does it is possible. For sure it is possible to redirect one address to other, but can it be done internally?...
Reply With Quote
  #601  
Old 08-05-2009, 01:30 AM
imported_silkroad imported_silkroad is offline
 
Join Date: Dec 2003
Posts: 563
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by NLP-er View Post
I checked first one '^(.+?)\.html\?hl=(.+?)$' => '$2/$1.html' and it crashed my forum So I commented it.
Sorry about that!

I tried something similar in .htaccess after posting above and it crashed here too.... driving the load average of the server to outer space

More later .....
Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 01:15 AM.


Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2024, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.05927 seconds
  • Memory Usage 2,312KB
  • Queries Executed 25 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)ad_showthread_beforeqr
  • (4)bbcode_code
  • (5)bbcode_quote
  • (1)footer
  • (1)forumjump
  • (1)forumrules
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (1)modsystem_post
  • (1)navbar
  • (4)navbar_link
  • (120)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (4)pagenav_pagelink
  • (2)pagenav_pagelinkrel
  • (11)post_thanks_box
  • (11)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (11)post_thanks_postbit_info
  • (10)postbit
  • (11)postbit_onlinestatus
  • (11)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open
  • (1)tagbit_wrapper 

Phrase Groups Available:
  • global
  • inlinemod
  • postbit
  • posting
  • reputationlevel
  • showthread
Included Files:
  • ./showthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showthread_start
  • showthread_getinfo
  • forumjump
  • showthread_post_start
  • showthread_query_postids
  • showthread_query
  • bbcode_fetch_tags
  • bbcode_create
  • showthread_postbit_create
  • postbit_factory
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • fetch_musername
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • pagenav_page
  • pagenav_complete
  • tag_fetchbit_complete
  • forumrules
  • navbits
  • navbits_complete
  • showthread_complete