Miscellaneous Hacks - vB Global Translator - Multiply your indexed pages & put search traffic on autopilot

**Text Removed**

[Dave Hybrid]

Originally Posted by imported_silkroad

Yes, agreed. That is what you say in this thread, and that is what we observe, but that is not what is said in the description of the mod

(wink, wink)

Where in the mod description does it say translated pages are identical speed to normal pages.

[imported_silkroad]

Originally Posted by NLP-er

I don't know google spiders algorithms, but if you will not expose some languages google definitively will not visit it

After running this great mod for around 4-5 days, I can advise that, for big boards with hundreds of thousands of posts, this mod will use a lot of disk space. Please keep in mind, there is a huge difference in translating 400K pages compared to 20K as far as storage requirements.

We have nearly 400K pages indexed by Google, and based on the current G index of newly translated pages compared to the size of the database, we will would use over 1 TB of disk space to store translations for all 28 flags in the database.

We don't have 1 TB of storage available for translations at this time , so until we have a new storage configuration that can store over a TB of data, we will only expose the Top 10 Internet-population languages.

We will monitor this for another week, and if the database continues to grow, we will have to cut back to the Top 5 because we can't allocate 100s of GB to translations. We did not size our server that large . FWIW: I am thinking to move the translation dB to Amazon EC2 and redirect translated pages to EC2 in the future.

It would be great to hear from others running this mod for many months to post how many posts and threads they have in vB, the number of translated links indexed by Google, and the size of their translated dB. Please post, thanks!

Thanks again for a great mod.

Also, I look forward to report back on search engine referral traffic increases in the coming months

[imported_silkroad]

Originally Posted by Dave Hybrid

Where in the mod description does it say translated pages are identical speed to normal pages.

Right here

Over time, users and bots will cache your entire site automatically and all translated pages will load the same as normal pages.

For me, and I am sure others, "load the same"... means "load the same"......

[Dave Hybrid]

Originally Posted by imported_silkroad

After running this great mod for around 4-5 days, I can advise that, for big boards with hundreds of thousands of posts, this mod will use a lot of disk space. Please keep in mind, there is a huge difference in translating 400K pages compared to 20K as far as storage requirements.

We have nearly 400K pages indexed by Google, and based on the current G index of newly translated pages compared to the size of the database, we will would use over 1 TB of disk space to store translations for all 28 flags in the database.

We don't have 1 TB of storage available for translations at this time , so until we have a new storage configuration that can store over a TB of data, we will only expose the Top 10 Internet-population languages.

We will monitor this for another week, and if the database continues to grow, we will have to cut back to the Top 5 because we can't allocate 100s of GB to translations. We did not size our server that large . FWIW: I am thinking to move the translation dB to Amazon EC2 and redirect translated pages to EC2 in the future.

It would be great to hear from others running this mod for many months to post how many posts and threads they have in vB, the number of translated links indexed by Google, and the size of their translated dB. Please post, thanks!

Thanks again for a great mod.

Also, I look forward to report back on search engine referral traffic increases in the coming months

Right, because 500,000 x28 = 14 million pages.

If you added 14 million normal pages you'd need a similar amount of space...

[Dave Hybrid]

Originally Posted by imported_silkroad

Right here



For me, and I am sure others, "load the same"... means "load the same"......

The difference is milliseconds, hardly a big deal. Jeez.

[imported_silkroad]

Originally Posted by Dave Hybrid

The difference is milliseconds, hardly a big deal. Jeez.

Hi Dave,

I don't understand you and why you get defensive.

First of all, I mentioned before that I did not want to post and get on your bad side, because I have read your defensive replies before, and I like you.

Then, you invited me to post performance topics.

Then, I post facts, which are important to me, a person who have a fairly large board, and you then get defensive again.

Milliseconds matter to many people (. Just because they don't matter to you is no reason to be defensive with me. I am not your enemy. In fact, it works out that the translated pages take about 40 to 50% longer to load in our server. No big deal, but it is certainly not "the same". 40 to 50% longer to load is not "the same"... why not be technically accurate?

I suggest you reword you mod description to say something like:

Over time, users and bots will cache your entire site automatically and all translated pages will load almost the same as normal pages.

Or better yet (more accurate, IMHO):

Over time, users and bots will cache your entire site automatically and all translated pages will load similar to normal pages, perhaps 40 to 50% slower.

Also, what is the point of trying to help (and improve the mod) you if you are going to be defensive about things which do not matter to you, but might be important to others? I like this mod and just happen to think performance details are important to people with large boards.

Advice: Don't beat up on your friends!

PS: If you are going to beat up on me when I post some performance stats, I better not post anymore stats! I am not posting performance stats for my benefit. I was posting for the benefit of users and to "give back" to you for such a great mod. Why beat me up over it? I think I will not post anymore stats, it is better, since you are so sensitive about it!!

[Dave Hybrid]

For me, and I am sure others, "load the same"... means "load the same"......

How is that helping, being pedantic over the wording of the install instructions? I said i cannot change a thing, i'm not a db coder and I dont have the time and money to invest right now for marginal differences if at all. I then said if you wanted to suggest actual code changes i would be happy test them. I'm not being defensive or whatever, but just like if you released a mod you would tire of the negativity at some point. Not one person has posted index stats, referral stats, it's all doom and gloom. As I said before if you want to change it, then be my guest, but all this talk is not improving a thing imo without actually editing it and testing it. Also i am not trying to offend you, please take my posts in a non offensive way if that's how you are interpreting them. Thanks.

[imported_silkroad]

Originally Posted by Dave Hybrid

How is that helping, being pedantic over the wording of the install instructions? I said i cannot change a thing, i'm not a db coder and I dont have the time and money to invest right now for marginal differences if at all. I then said if you wanted to suggest actual code changes i would be happy test them. I'm not being defensive or whatever, but just like if you released a mod you would tire of the negativity at some point. Not one person has posted index stats, referral stats, it's all doom and gloom. As I said before if you want to change it, then be my guest, but all this talk is not improving a thing imo without actually editing it and testing it. Also i am not trying to offend you, please take my posts in a non offensive way if that's how you are interpreting them. Thanks.

Posting performance details are not negative Dave. You are the person taking it that way because you are so sensitive.

Like I said before, I am not going to post anymore performance stats, because it upsets you so much to learn how your mod performs. I don't want to get on your bad side.

NO MORE STATS... Happy now??

[imported_silkroad]

After thinking about this a bit more, I want close on this:

(1) Before we can recommend code changes, database modifications, etc. we should have good performance statistics. For this reason, I think recommendations based on solid statistics are more important than recommendations based on opinions. (It is kinda like having a doctor write a prescription without examining the patient first...) On our site, we run over 350 MySQL stats and tune the dB based on analysis of charts, graphs, etc. over hours, days, weeks, months and more. We look a spider hits per minute, server load, table opens, cache, memory, network load, many more than 600 individual statistics. We look at Apache workers, MySQL threads... I think we look at nearly 600 stats, but normally we can get a good idea at what is going on by a review of about 8 to 10 charts in a dashboard.

(2) This mod is resource intensive for big boards. Saying this is not "doom and gloom" (as someone has complained), it is a fact. When a process is resource intensive, we should understand it, especially people who have big boards, and its impact. We should know the impact so we can plan, provision, size, adjust, etc. Just the GoogleBot load alone increases our load average and network utlization considerably. We need to know what that is because "knowledge is important", not because we are being "negative". It is not "doom and gloom" to say this - this is called "performance facts for planning."

(3) For some odd reason, emotions run high in this mod about performance statistics; so we will not publish them here any more, but will publish them on another site (because we need stats - it is called "situational knowledge"). We were publishing these stats to help people using this mod, but instead, we have been met with an unapologetic "why are you doing this?" and "jeezz, why do you care about this or that." Why should we publish statistics if statistics lead to emotional replies? Emotions are not interesting, Performance is. I am a Vulcan, not a Klingon :-)

(4) If anyone wants access to our statistics, please send me a PM. I'll provide you the link to a private forum where we can publish and discuss performance issues openly and technically, without stimulating unapologetic emotional replies and question on our motives. I have no interest in emotions when it comes to web server performance. "Just the facts, Maam", as they say.

(5) I want to close by thanking Dave for this great mod. We use it. We like it. We are tracking it's performance. In accordance with Dave's wishes, since it is his mod, we will refrain from posting any more performance related stats, graphs, etc. here. I can't deal with the emotions that stats seem to invoke anyway. It is against my Vulcan nature :-)

Keep up the great work! I cannot make code recommendations for improving performance without solid statistics :-) Sorry!

[imported_silkroad]

Hey Guys!

(No stats, I promise!)

Hope all is well.

Question: Does your mod parse the "notranslate" tag and pass it to Google when it does the translation?

<span class="notranslate">Code not to translate</span>

Google says to use this tag when you don't want something translated.

I wrapped it around $code in the bbcode_code template, but it did not seem to work.

Cheers.