vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vBulletin 3.8 Add-ons (https://vborg.vbsupport.ru/forumdisplay.php?f=235)
-   -   Forum Display Enhancements - vB Enterprise Translator (https://vborg.vbsupport.ru/showthread.php?t=220886)

imported_silkroad 10-02-2009 04:17 PM

Quote:

Originally Posted by KrisP (Post 1893800)
Ok, thanks - but I thought the purpose of wget was to filling up the cache, then what is the purpose of fetching links?

With regards to filling up the cache I am now using "Website downloader for windows" - it works, but of course taking up some bandwith while doing it.

Yes, the purpose is to populate the cache. I works fine for us. Any correct link that returns a 200 will cause vBGT to get populate the cache. We use wget, as described and it works great for you.

I am not following your problem.

If it is not working, you need to post examples from your input and output file, as requested. Otherwise, how would we know if your input file to wget is correct?

KrisP 10-02-2009 04:34 PM

Here it is:

detest2.txt

Quote:

http://www.myforum.org/showthread.ph...73&language=de
http://www.myforum.org/showthread.ph...55&language=de
http://www.myforum.org/showthread.ph...69&language=de
http://www.myforum.org/showthread.ph...67&language=de
http://www.myforum.org/showthread.ph...08&language=de
http://www.myforum.org/showthread.ph...83&language=de
http://www.myforum.org/showthread.ph...38&language=de
http://www.myforum.org/showthread.ph...53&language=de
http://www.myforum.org/showthread.ph...28&language=de
http://www.myforum.org/showthread.ph...72&language=de
http://www.myforum.org/showthread.ph...=2&language=de
http://www.myforum.org/showthread.ph...05&language=de
http://www.myforum.org/showthread.ph...83&language=de
http://www.myforum.org/showthread.ph...63&language=de
http://www.myforum.org/showthread.ph...48&language=de
http://www.myforum.org/showthread.ph...99&language=de
wget -b -O /dev/null -i detest2.txt -o links.txt

links.txt
Quote:

--19:27:04-- http://www.myforum.org/showthread.ph...73&language=de
Resolving www.myforum.org... 85.25.73.125
Connecting to www.myforum.org|85.25.73.125|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: `/dev/null'

0K .......... .......... ......... 355M=0s

19:27:05 (355 MB/s) - `/dev/null' saved [30528]

--19:27:05-- http://www.myforum.org/showthread.ph...55&language=de
Connecting to www.myforum.org|85.25.73.125|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: `/dev/null'

0K .......... .......... ......... 492M=0s

19:27:05 (492 MB/s) - `/dev/null' saved [29896]

--19:27:05-- http://www.myforum.org/showthread.ph...69&language=de
Connecting to www.myforum.org|85.25.73.125|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: `/dev/null'

0K .......... .......... ......... 1.92M=0.01s

19:27:06 (1.92 MB/s) - `/dev/null' saved [29883]

--19:27:06-- http://www.myforum.org/showthread.ph...67&language=de
Connecting to www.myforum.org|85.25.73.125|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: `/dev/null'

0K .......... .......... ......... 297M=0s

19:27:07 (297 MB/s) - `/dev/null' saved [29871]

--19:27:07-- http://www.myforum.org/showthread.ph...08&language=de
Connecting to www.myforum.org|85.25.73.125|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: `/dev/null'

0K .......... .......... ......... 380M=0s

19:27:07 (380 MB/s) - `/dev/null' saved [29870]

--19:27:07-- http://www.myforum.org/showthread.ph...83&language=de
Connecting to www.myforum.org|85.25.73.125|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: `/dev/null'

0K .......... .......... ......... 361M=0s

19:27:09 (361 MB/s) - `/dev/null' saved [29878]

--19:27:09-- http://www.myforum.org/showthread.ph...38&language=de
Connecting to www.myforum.org|85.25.73.125|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: `/dev/null'

0K .......... .......... ......... 285M=0s

19:27:11 (285 MB/s) - `/dev/null' saved [29872]

--19:27:11-- http://www.myforum.org/showthread.ph...53&language=de
Connecting to www.myforum.org|85.25.73.125|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: `/dev/null'

0K .......... .......... ......... 419M=0s

19:27:12 (419 MB/s) - `/dev/null' saved [29876]

--19:27:12-- http://www.myforum.org/showthread.ph...28&language=de
Connecting to www.myforum.org|85.25.73.125|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: `/dev/null'

0K .......... .......... ......... 347M=0s

19:27:12 (347 MB/s) - `/dev/null' saved [29878]

--19:27:12-- http://www.myforum.org/showthread.ph...72&language=de
Connecting to www.myforum.org|85.25.73.125|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: `/dev/null'

0K .......... .......... ......... 15.2M=0.002s

19:27:13 (15.2 MB/s) - `/dev/null' saved [29876]

--19:27:13-- http://www.myforum.org/showthread.ph...=2&language=de
Connecting to www.myforum.org|85.25.73.125|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: `/dev/null'

0K .......... .......... ......... 352M=0s

19:27:14 (352 MB/s) - `/dev/null' saved [30263]

--19:27:14-- http://www.myforum.org/showthread.ph...05&language=de
Connecting to www.myforum.org|85.25.73.125|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: `/dev/null'

0K .......... .......... ......... 219M=0s

19:27:14 (219 MB/s) - `/dev/null' saved [29873]

--19:27:14-- http://www.myforum.org/showthread.ph...83&language=de
Connecting to www.myforum.org|85.25.73.125|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: `/dev/null'

0K .......... .......... ......... 2.63M=0.01s

19:27:17 (2.63 MB/s) - `/dev/null' saved [29880]

--19:27:17-- http://www.myforum.org/showthread.ph...63&language=de
Connecting to www.myforum.org|85.25.73.125|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: `/dev/null'

0K .......... .......... ......... 291M=0s

19:27:17 (291 MB/s) - `/dev/null' saved [29870]

--19:27:17-- http://www.myforum.org/showthread.ph...48&language=de
Connecting to www.myforum.org|85.25.73.125|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: `/dev/null'

0K .......... .......... ......... 331M=0s

19:27:18 (331 MB/s) - `/dev/null' saved [29879]

--19:27:18-- http://www.myforum.org/showthread.ph...99&language=de
Connecting to www.myforum.org|85.25.73.125|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: `/dev/null'

0K .......... .......... ......... 310M=0s

19:27:18 (310 MB/s) - `/dev/null' saved [29880]

FINISHED --19:27:18--
Downloaded: 16 files, 468K in 0.03s (15.9 MB/s)
For some reason it seems to save to /dev/null right now - I am calling wget from "httpdocs" = forum root

just wget http://www.myforum.org/showthread.ph...=2&language=ja

gives:

Quote:

Resolving www.myforum.org... 85.25.73.125
Connecting to www.myforum.org|85.25.73.125|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: `showthread.php?t=978.1'

[ <=> ] 148,906 --.-K/s in 0.001s

19:56:57 (240 MB/s) - `showthread.php?t=978.1' saved [148906]
Here is another example:

If I click a link I can see vbenterprisetranslator_cache_xyz table increases - when I run wget the table dosent increase. wget simply has no effect on the cache in my end.

KrisP 10-02-2009 05:02 PM

If I want to manully empty the cache at some point. Then I can simply "empty cache" in phpmyadmin for the 3 vbenterprisetranslator_cache tables?

imported_silkroad 10-02-2009 05:04 PM

Thanks.

It works for us, not sure why it does not work for you.

Anyway, if you get it to work for you, please post back your working wget code. Thanks for posting.

Cheers.

KrisP 10-02-2009 05:21 PM

Quote:

Originally Posted by imported_silkroad (Post 1893831)
Thanks.

It works for us, not sure why it does not work for you.

Anyway, if you get it to work for you, please post back your working wget code. Thanks for posting.

Cheers.

I will, surely would be easier that way.

******************

Typo in language= vbseo sitemap mod:

Quote:


//additional code
$alanguages = array ('af','sq','ar','be','bg','ca','zh-CN','hr','cs','da','nl','en','et','tl','fi','fr',' gl','de','el','iw','hi','hu','is','id','ga','it',' ja','ko','lv','lt','mk','ms','mt','no','fa','pl',' pt','ro','ru','sr','sk','sl','es','sw','sv','zh-TW','th','tr','uk','vi','cy','yi');
if(!$archived)
foreach($alanguages as $language) {
$vbseo_stat['t']++;
vbseo_add_url(vbseo_url_thread($threadrow, $p, $archived).'?language='.$language, $prior, $threadrow['lastpost'], $freq);
}
//end additional code
should be &amp instead of ? like this:

Quote:

$archived).'&amplanguage='.$language

imported_silkroad 10-02-2009 05:51 PM

Hey KrisP,

You can always test it by sending the output to a file (or the screen) versus sending the output to /dev/null.

Pulling with wget is not any different than pulling with a browsers, etc, as you know well, so you can check it easily by sending the output to a file or the screen.

imported_silkroad 10-02-2009 05:55 PM

Hey KrisP,

Try this and see if it works for you...

wget -b -i detest2.txt -o links.txt

or

wget -i detest2.txt -o links.txt

imported_silkroad 10-02-2009 05:59 PM

Hello Again KrisP,

I just tested it with

wget -b -O testfile.txt -i detest2.txt -o links.txt

and it works fine....

I could see the translations in the testfile.txt

All was OK.

Piping the output to /dev/null does not stop wget from pulling the file and vBGT from translating it....

Cheers.

KrisP 10-02-2009 07:24 PM

Yes writing to a file then the cache get filled! Problem is that this takes 20 times longer than downloading with "Website downloader for windows".

Unfortunately I started a large file with wget - it could take days.

Do you know how I could terminate a running wget job?

EDIT: Seems kill "pid nr" did the job.

imported_silkroad 10-02-2009 07:46 PM

Quote:

Originally Posted by KrisP (Post 1893911)
Yes writing to a file then the cache get filled! Problem is that this takes 20 times longer than downloading with "Website downloader for windows".

Unfortunately I started a large file with wget - it could take days.

Do you know how I could terminate a running wget job?

EDIT: Seems kill "pid nr" did the job.
.

Sorry, but that is ridiculous.....

Obviously, if you don't know how to kill a running process on unix/linux you don't have enough experience to actually know what you are talking about regarding performance.

There is no reason that wget runs longer than something else (especially a windoze platform), unless you have a configuration problem or are running on different platforms , different networks, etc, etc.

You are posting misinformation base on your lack of knowledge and experience, obvious by asking how to kill a running process.


All times are GMT. The time now is 11:02 PM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01946 seconds
  • Memory Usage 1,798KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (8)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (4)pagenav_pagelink
  • (4)pagenav_pagelinkrel
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (10)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete