vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vBulletin 3.8 Add-ons (https://vborg.vbsupport.ru/forumdisplay.php?f=235)
-   -   Forum Display Enhancements - vB Enterprise Translator (https://vborg.vbsupport.ru/showthread.php?t=220886)

KrisP 10-02-2009 08:06 PM

Hey champ

wget fetches one link at a time serially that takes 1-5 seconds to load each while "Website downloader for windows" is downloading 20 links parallel at a time.

imported_silkroad 10-03-2009 05:03 AM

Quote:

Originally Posted by KrisP (Post 1893925)
Hey champ

wget fetches one link at a time serially that takes 1-5 seconds to load each while "Website downloader for windows" is downloading 20 links parallel at a time.

First of all, if you want wget to download 20 links in parallel, you can simply run twenty instances. If you want wget to download 100 links in parallel, you can simply run 100 instances, etc.

Second, most people do not want to put the type of load you are talking about on a production server. For example, our forum gets more than 4,000,000 page views a month, so there is NO WAY we would run any process that spiders 20 links in parallel (we even regulate how GoogleBot spiders our site).

As I said earlier KrisP, you don't understand the details and implications of what you are talking about. You don't understand the basics of performance management, system management, and seem to be a "windows user fan" who just wants to make a statement about how great windows it versus a unix/linux command line tool. So be it, but you are simply spreading misinformation here.

Of course, GoogleBot uses a variety of wget for all their spidering, so I guess you will argue with Google as well ;) I promise you Google does not use a windows spidering tool, ROTFL.

If you want to run 1000 parallel instances of wget, do it. Anyone who understands basic command line scripting could write this script in less than 10 minutes.

Like I said earlier you have a (1) configuration problem and you also have a (2) lack experience and knowledge issue, obvious by your posts. That is no problem. We are all glad to help you, but do not post misinformation here (please!) about how to use wget and how great windows is over unix/linux command line knowledge and expertise.

NLP-er 10-03-2009 09:44 PM

Quote:

Originally Posted by KrisP (Post 1893828)
If I want to manully empty the cache at some point. Then I can simply "empty cache" in phpmyadmin for the 3 vbenterprisetranslator_cache tables?

Use SQL to empty cache tables.

NLP-er 10-03-2009 09:47 PM

Quote:

Originally Posted by KrisP (Post 1893845)
I will, surely would be easier that way.

******************

Typo in language= vbseo sitemap mod:



should be &amp instead of ? like this:

This code is given by vbSEO staff, because sitemap generator is owned by vbSEO. I'm using links in SEO style, so cannot tell you about results for links in language param style produced by sitemap generator. Do you see wrong results in sitemap? If no then it is ok. If yes then made the change an check it - also let us know about your results. I will gladly correct this code for sitemap generator if there is any bug :)

GoTTi 10-04-2009 02:56 AM

Quote:

Originally Posted by NLP-er (Post 1892178)
Flags are generated by templates, so everyone can customize the look according to its own requirements. Just edit 3 templates for flags and use custom place :)

FLAG - USA - just override the gif with England flag and that's it. The description says what is the language, and in USA it is still English.

how would i go about then making it a dropdown option?

NLP-er 10-04-2009 12:04 PM

Quote:

Originally Posted by GoTTi (Post 1894477)
how would i go about then making it a dropdown option?

Change templates:
vbenterprisetranslator_flag
vbenterprisetranslator_flags_begin
vbenterprisetranslator_flags_end

Begin and end opens and closes div, and flag is one link. So you can customize it as you wish.

KrisP 10-04-2009 03:49 PM

Quote:

Originally Posted by NLP-er (Post 1894378)
This code is given by vbSEO staff, because sitemap generator is owned by vbSEO. I'm using links in SEO style, so cannot tell you about results for links in language param style produced by sitemap generator. Do you see wrong results in sitemap? If no then it is ok. If yes then made the change an check it - also let us know about your results. I will gladly correct this code for sitemap generator if there is any bug :)

EDIT: &

Yes, if this change is not made all links i sitemap will look like this, fx. :

http:/www.mysite.com/showthread.php?t=205435?language=en

instead of

http:/www.mysite.com/showthread.php?t=205435&language=en

BTW: There is also the posibillity to generate default sitemap and then search/replace:

Find: </loc>
Replace: &amp;language=fi</loc>

(except first link <loc>http://www.mysite.com/?language=sv</loc> that must be changed back to ?)

And save as xx.xml for each language to get an overview of indexing different languages.

(of course you have to do this manually every time you want sitemap updated - or you can just do it the first time and then change to big sitemap later)

KrisP 10-04-2009 03:53 PM

Is it possible to keep UI untranslated?

imported_silkroad 10-04-2009 03:59 PM

Quote:

Originally Posted by KrisP (Post 1894675)
BTW: There is also the posibillity to generate default sitemap and then search/replace:

This is a much better way to do this.

I have a script that copies the vbseo_sitemaps and generates sitemaps for about 15 languages, moves them to their own subdirectories (one for each language) and then pings google after each one is updated.

From experience, the size of your forum makes a big (very big) difference in how you approach indexing translations in Google.

If you have a large forum with hundreds of thousands of post, you will hurt your traffic if you translate all languages and create sitemaps for all languages, because Google will not index all, and you will then have lots of links from low traffic languages.

It is better, for large sites, to only index the top 10 languages and definitely do not make all the flags viable or you will have less traffic than targeting the major languages with high Internet usage.

KrisP 10-04-2009 04:14 PM

I see your point. However from my perspective I am doing a little experiment of creating some language specific domains (uploading a copy of the forum to these) - only showing one language per language specific domain. That is why I need seperate sitemaps. Hopefully this strategy will give good indexing.

I use language= links and this robots.txt to make spiders only spider the specific language (if some of you see a flaw in the sitemap, I would of course be very interested to know :) )

Quote:

User-agent: Googlebot
Disallow: /_gsdata_/
Disallow: /admincp/
Disallow: /archive/
Disallow: /banner/
Disallow: /cgi-bin/
Disallow: /chat/
Disallow: /chat/
Disallow: /chat1/
Disallow: /chat2/
Disallow: /clientscript/
Disallow: /cpstyles/
Disallow: /css/
Disallow: /customavatars/
Disallow: /customprofilepics/
Disallow: /forums/
Disallow: /geek/
Disallow: /groups/
Disallow: /icon/
Disallow: /images/
Disallow: /impex/
Disallow: /includes/
Disallow: /install/
Disallow: /misc/
Disallow: /modcp/
Disallow: /phpbb/
Disallow: /forum_phpbb/
Disallow: /irc/
Disallow: /picture_library/
Disallow: /plesk-stat/
Disallow: /signaturepics/
Disallow: /tem/
Disallow: /test/
Disallow: /tg3/
Disallow: /upload/
Disallow: /vbseo/
Disallow: /vbseo_sitemap/
Disallow: /wiki/
Disallow: /*.php$
Disallow: /*order
Disallow: /*sort
Disallow: /*mode
Disallow: /*goto
Disallow: /*nojs
Disallow: /*s=1
Disallow: /*s=2
Disallow: /*s=3
Disallow: /*s=4
Disallow: /*s=5
Disallow: /*s=6
Disallow: /*s=7
Disallow: /*s=8
Disallow: /*s=9
Disallow: /*s=0
Disallow: /*s=e1
Disallow: /*s=e2
Disallow: /*s=3e
Disallow: /*s=e4
Disallow: /*s=e5
Disallow: /*s=e6
Disallow: /*s=e7
Disallow: /*s=e8
Disallow: /*s=e9
Disallow: /*s=e0
Disallow: /*1$
Disallow: /*2$
Disallow: /*3$
Disallow: /*4$
Disallow: /*5$
Disallow: /*6$
Disallow: /*7$
Disallow: /*8$
Disallow: /*9$
Disallow: /*0$
Disallow: /*language=af
Disallow: /*language=be
Disallow: /*language=bg
Disallow: /*language=ca
Disallow: /*language=cs
Disallow: /*language=cy
Disallow: /*language=da
Disallow: /*language=de
Disallow: /*language=el
Disallow: /*language=en_use_this
Disallow: /*language=es
Disallow: /*language=et
Disallow: /*language=fa
Disallow: /*language=fi
Disallow: /*language=fr
Disallow: /*language=ga
Disallow: /*language=gl
Disallow: /*language=hi
Disallow: /*language=hr
Disallow: /*language=hu
Disallow: /*language=id
Disallow: /*language=is
Disallow: /*language=it
Disallow: /*language=iw
Disallow: /*language=ja
Disallow: /*language=ko
Disallow: /*language=lt
Disallow: /*language=lv
Disallow: /*language=mk
Disallow: /*language=ms
Disallow: /*language=mt
Disallow: /*language=nl
Disallow: /*language=no
Disallow: /*language=pl
Disallow: /*language=pt
Disallow: /*language=ro
Disallow: /*language=ru
Disallow: /*language=sk
Disallow: /*language=se
Disallow: /*language=sl
Disallow: /*language=sq
Disallow: /*language=sr
Disallow: /*language=sv
Disallow: /*language=sw
Disallow: /*language=th
Disallow: /*language=tl
Disallow: /*language=tr
Disallow: /*language=uk
Disallow: /*language=vi
Disallow: /*language=yi
Disallow: /*language=zh-CN
Disallow: /*language=zh-TW
Googlebot should adhere to above, I am a bit unsure if there is syntax in above that other spiders will not adhere to.

I dont use the folder structure ("seo links") because I couldnt find a way to use robots.txt to narrow down to one language only using that type of links.


All times are GMT. The time now is 02:14 AM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.02199 seconds
  • Memory Usage 1,767KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (8)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (4)pagenav_pagelink
  • (4)pagenav_pagelinkrel
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (10)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete