vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vBulletin 4.x Add-ons (https://vborg.vbsupport.ru/forumdisplay.php?f=245)
-   -   Administrative and Maintenance Tools - Import External Images (https://vborg.vbsupport.ru/showthread.php?t=253309)

y2ksw 10-10-2012 07:21 AM

Quote:

Originally Posted by Reinhard (Post 2371040)
@y2ksw: Can you add the postid in the table iei_img? This makes it easier to find wrong urls in the post.

Scheduled for next review :)

inigo 10-10-2012 08:51 AM

One question, is it possible to retreive the images and upload to other server?

For exaple giving a FTP account, so the forum domain is:

www.forum.com

And all the images are stored in other server/domain, for example

www.forumimages.com

so you have them in your server n?2, and all the posts in FORUM (in server 1) links them as:

[IMG ]http://www.forumimages.com/image 1.jpg [/IMG ]

Thanks!

sticky 10-10-2012 09:05 AM

Quote:

Originally Posted by Krusty1231 (Post 2370367)
Is there something I could use with this mod to watermark my images? Does anyone else use something to watermark the images, and willing to share?

Thanks in advance!

Same, this would be awesome...

y2ksw 10-11-2012 11:13 AM

Quote:

Originally Posted by inigo (Post 2371967)
One question, is it possible to retreive the images and upload to other server?

For exaple giving a FTP account, so the forum domain is:

www.forum.com

And all the images are stored in other server/domain, for example

www.forumimages.com

so you have them in your server n?2, and all the posts in FORUM (in server 1) links them as:

[IMG ]http://www.forumimages.com/image 1.jpg [/IMG ]

Thanks!

Please see here. :)

y2ksw 10-11-2012 11:15 AM

Quote:

Originally Posted by sticky (Post 2371968)
Same, this would be awesome...

I am against watermarking images coming from other sites and thus will not implement this feature.

If you want to watermark the files, you may use quite easily a self-tailored script from SSH, or via cronjob and PHP, operating directly on the imported files.

sticky 10-12-2012 09:21 PM

This mod works almost perfectly except when a image is something like IMG_1123-1.jpg?t=1349992120 .

If there is anything after the .jpg it rarely imports correctly.

sticky 10-12-2012 09:21 PM

Quote:

Originally Posted by y2ksw (Post 2372270)
I am against watermarking images coming from other sites and thus will not implement this feature.

If you want to watermark the files, you may use quite easily a self-tailored script from SSH, or via cronjob and PHP, operating directly on the imported files.

Well it's more that people use you as a host and steal your bandwith so you should get credit for you bandwith/server use.

I honestly don't know how to do what you mentioned but would love to learn and implement it...

BadgerDog 10-13-2012 09:59 AM

Quote:

Originally Posted by sticky (Post 2372603)
This mod works almost perfectly except when a image is something like IMG_1123-1.jpg?t=1349992120 .

If there is anything after the .jpg it rarely imports correctly.

I have exactly the same problem with filenamse containing a "-"....

Refer to my original post and y2ksw's anser following a few posts later:

Post 367 (click here)

From his answer, I assume there's nothing can be done about the issue... :(

Other than that, this is a fabulous mod and a great addition to our site... :up:

Regards,
Doug

y2ksw 10-15-2012 03:37 PM

Quote:

Originally Posted by sticky (Post 2372603)
This mod works almost perfectly except when a image is something like IMG_1123-1.jpg?t=1349992120 .

If there is anything after the .jpg it rarely imports correctly.

You may convert images to jpg and then all images will not carry the original filename and/or extension.

However, if an image is dynamically linked, visibility may depend on your logged in state (or the state the "pasting" user is in) and thus may not work in any case. The server script is not logged into the remote media server (is a guest) and thus may not see anything.

ZEHH 10-16-2012 05:37 PM

Muito bom !!

lazydesis 11-02-2012 02:43 PM

this is working fine for me on vb3.8.7 .. just needed to remove the dependencies on the product file for it be installed

thanks

Bob_R 11-14-2012 09:33 PM

I'm interested in this mod. Should I download 1.0.2, 1.0.4, or 1.0.5? :confused: I assume 1.0.2 but I wish to be sure before I proceed. :)

And, what happened to 1.0.3? :D

sticky 11-15-2012 06:58 AM

Quote:

Originally Posted by y2ksw (Post 2373187)
You may convert images to jpg and then all images will not carry the original filename and/or extension.

However, if an image is dynamically linked, visibility may depend on your logged in state (or the state the "pasting" user is in) and thus may not work in any case. The server script is not logged into the remote media server (is a guest) and thus may not see anything.

That's not the issue. The issue is if someone is linking to a file that has anything after the .jpg. Then it doesn't import correctly.

y2ksw 11-15-2012 02:04 PM

Quote:

Originally Posted by Bob_R (Post 2381125)
I'm interested in this mod. Should I download 1.0.2, 1.0.4, or 1.0.5? :confused: I assume 1.0.2 but I wish to be sure before I proceed. :)

And, what happened to 1.0.3? :D

normally you would choose the latest version. 1.0.5 :)

Bob_R 11-16-2012 06:36 PM

Quote:

Originally Posted by y2ksw (Post 2381255)
normally you would choose the latest version. 1.0.5 :)

Gotcha ya!

It hasn't finished importing all the images yet. So, I hit Run Now in the Scheduled Task Manager and got this:

Request Timeout

This request takes too long to process, it is timed out by the server. If it should not be timed out, please contact administrator of this web site to increase 'Connection Timeout'.


Anything I can do about this?

It's scheduled to run every 10 minutes but the latest images imported were at 10:35 this morning :confused: about 4 hours ago.

EDIT

Another question

Include Forum ID's and Exclude Forum ID's

I did not enter any forumids in either box. Is this correct?

Thanks!!

y2ksw 11-17-2012 11:47 AM

Quote:

Originally Posted by Bob_R (Post 2381673)
Gotcha ya!

It hasn't finished importing all the images yet. So, I hit Run Now in the Scheduled Task Manager and got this:

Request Timeout

This request takes too long to process, it is timed out by the server. If it should not be timed out, please contact administrator of this web site to increase 'Connection Timeout'.


Anything I can do about this?

It's scheduled to run every 10 minutes but the latest images imported were at 10:35 this morning :confused: about 4 hours ago.

EDIT

Another question

Include Forum ID's and Exclude Forum ID's

I did not enter any forumids in either box. Is this correct?

Thanks!!

1. There is nothing I can do about connection timeouts. It may be your PHP hosting plan has Safe Mode enabled and thus will timeout at the system settings. Or, the server is simply too busy to make fast connections on outgoing requests.
2. You should not play with these (actually all) options unless you really need to :)

Bob_R 11-17-2012 02:29 PM

Quote:

Originally Posted by y2ksw (Post 2381856)
1. There is nothing I can do about connection timeouts. It may be your PHP hosting plan has Safe Mode enabled and thus will timeout at the system settings. Or, the server is simply too busy to make fast connections on outgoing requests.
2. You should not play with these (actually all) options unless you really need to :)

OK.

So what do I do?

It hasn't run in nearly 24 hours.

Thanks.

Bob_R 11-17-2012 06:35 PM

These are instructions from the PDF file:

Large image quantities
If you have a very high number of images, the iei_cron.php task may run out of memory. If this happens, you can empty the iei_img table. By doing so, the script will start over with a new array of imported images, which is acceptable once and then. If you want to keep the history, please feel free to keep a backup of this table.


Please explain in detail how to do this.

This may be my problem. I've reduced the posts at once to 5. Convert to jpg and disabled Cache Image URL's.

y2ksw 11-18-2012 12:10 PM

Quote:

Originally Posted by Bob_R (Post 2382001)
These are instructions from the PDF file:

Large image quantities
If you have a very high number of images, the iei_cron.php task may run out of memory. If this happens, you can empty the iei_img table. By doing so, the script will start over with a new array of imported images, which is acceptable once and then. If you want to keep the history, please feel free to keep a backup of this table.


Please explain in detail how to do this.

This may be my problem. I've reduced the posts at once to 5. Convert to jpg and disabled Cache Image URL's.

If you have this option (depends on release you are using):

Cache Image URL's
Cache image URL's into memory. If you have a large board, a lot of imported images and limited memory, you may want to switch this option off. If disabled, images are tested by less efficient database queries.

Try to switch it off, first (No). Then, each request for an image is queried from the database instead of loading the file list into memory. If this does still not work, then you have a different problem.

Rckcrwlr 11-20-2012 12:38 PM

I'm in the process of a doing a new install with my existing DB. It got me thinking...if I uninstall this, what can I expect to happen?

Will it say with them locally?
Default back to original?
Lose all images?

Thanks
John

y2ksw 11-20-2012 09:11 PM

Quote:

Originally Posted by Rckcrwlr (Post 2382895)
I'm in the process of a doing a new install with my existing DB. It got me thinking...if I uninstall this, what can I expect to happen?

Will it say with them locally?
Default back to original?
Lose all images?

Thanks
John

A new install with the same database and all data? how? :)

At worst, the new installation of this product will try to re-import the images. However the uninstall code should be commented out and the lookup table should remain in place. Thus, reinstalling the plugin should not do any harm.

If the uninstallation code is not commented out, you will not loose any images though, because they are stored to your web space.

webrats 11-26-2012 08:08 PM

can we store the images in the DB

y2ksw 11-27-2012 06:03 PM

Quote:

Originally Posted by webrats (Post 2385378)
can we store the images in the DB

No. This plugin is intended to download images from external sites and store them to the file system. It is not meant to be a revamped or integrated attachment system :)

webrats 12-03-2012 02:12 AM

Quote:

Originally Posted by y2ksw (Post 2385794)
No. This plugin is intended to download images from external sites and store them to the file system. It is not meant to be a revamped or integrated attachment system :)

to bad, it make it hard for people with multiple servers to use :(

can you associate a sub-domain with the images?

Manoel J?nior 12-03-2012 09:00 PM

Is there any way to debug and verify because the product in my Forum stopped working. Is there any way to debug and verify?

y2ksw 12-04-2012 08:27 AM

Quote:

Originally Posted by webrats (Post 2387902)
to bad, it make it hard for people with multiple servers to use :(

can you associate a sub-domain with the images?

You may redirect images via .htaccess, for example.

I don't see the problem however. If you have multiple servers, how do the images influence their manner of "seing" images? Could you make an example of what you ahve and what you would like to have?

y2ksw 12-04-2012 08:28 AM

Quote:

Originally Posted by Manoel J?nior (Post 2388177)
Is there any way to debug and verify because the product in my Forum stopped working. Is there any way to debug and verify?

One of the possible issues are missing space, but also server settings. If your server disallow pulling in external content (sockets, curl, fopen) it is likely not working.

webrats 12-04-2012 09:10 AM

Quote:

Originally Posted by y2ksw (Post 2388315)
You may redirect images via .htaccess, for example.

I don't see the problem however. If you have multiple servers, how do the images influence their manner of "seing" images? Could you make an example of what you ahve and what you would like to have?

all my servers are behind a load balancer , they are all clones of each other.
you hit a random server every time you hit my site.
the easiest fix is to push the images to the db since. all the servers grab the images from the DB. since the db stores ALL the images its very easy to keep everything updated and accurate on all the servers.

y2ksw 12-04-2012 02:13 PM

Quote:

Originally Posted by webrats (Post 2388321)
all my servers are behind a load balancer , they are all clones of each other.
you hit a random server every time you hit my site.
the easiest fix is to push the images to the db since. all the servers grab the images from the DB. since the db stores ALL the images its very easy to keep everything updated and accurate on all the servers.

If the servers are cloned, they should replicate/mirror the images after a while, too ... or not?

tourajabbasi 12-06-2012 04:46 AM

Hi,

My server suddenly stopped importing pictures...
can you tell me which settings do i have to check ?
(sockets, curl, fopen) where are they in the server?

We are using dedicated server / centos 6 / 64bit

Thank you

y2ksw 12-06-2012 07:14 AM

Quote:

Originally Posted by tourajabbasi (Post 2388840)
Hi,

My server suddenly stopped importing pictures...
can you tell me which settings do i have to check ?
(sockets, curl, fopen) where are they in the server?

We are using dedicated server / centos 6 / 64bit

Thank you

You first should check if your firewall allows to pull in external data, before anything else. Then, if PHP allows to use fopen on external sources, then which options are checked. If fopen does not allow to pull data, you must have CURL instead. The plugin prefers CURL over sockets and falls back to sockets, unless you choose to use only sockets.

Manoel J?nior 12-16-2012 12:53 AM

Quote:

Originally Posted by y2ksw (Post 2388316)
One of the possible issues are missing space, but also server settings. If your server disallow pulling in external content (sockets, curl, fopen) it is likely not working.

Searching deeper, more exactly in error_log me this message appears:

Code:

[16-Dec-2012 00:33:19 UTC] PHP Fatal error:  Allowed memory size of 134217728 bytes exhausted (tried to allocate 2800 bytes) in /home/test/public_html/forum/includes/cron/iei_cron.php on line 92
Was that why the product is not working properly? What should I do?

y2ksw 12-18-2012 03:36 PM

Quote:

Originally Posted by Manoel J?nior (Post 2390994)
Searching deeper, more exactly in error_log me this message appears:

Code:

[16-Dec-2012 00:33:19 UTC] PHP Fatal error:  Allowed memory size of 134217728 bytes exhausted (tried to allocate 2800 bytes) in /home/test/public_html/forum/includes/cron/iei_cron.php on line 92
Was that why the product is not working properly? What should I do?

I think the product tried to load a huge image. PHP usually has a space limit and in this case it has 128 MB per process and this memory ran out of space. Maybe you need to enable the image resizing and trim imported images down to a suitable limit.

Manoel J?nior 12-19-2012 11:30 PM

Hi y2ksw,

That even when not doing more cache have to put the value 0 in attributes: Maximum Width and Maximum Height.

When I put 0 value stopped giving error and now is doing the caching of images.

Thanks for all the help and serves as a warning to others.

Doganay YILDIZ 12-22-2012 01:16 PM

There is a problemmi? Pictures ftp uploading beautifully. However, I opened the new topics added almost 6 hours but still ftp. What's the problem?

cylon1 12-26-2012 05:36 AM

Dear friends:

This extension is amazing, I use it since months, and all works very well. The only problem is that, I'm using a vps with limited resources (apache, 512Mb ram). I've noticed that one of the slowest sql in my vps is the following:

Code:

# Query_time: 16.976461  Lock_time: 0.000214 Rows_sent: 0  Rows_examined: 278721
SET timestamp=1356435021;
SELECT postid, dateline, pagetext
        FROM post
        WHERE iei_parsed=0
            AND pagetext LIKE '%[/IMG]%'
        ORDER BY postid
        LIMIT 0, 5;

As you can see, my posts table has only 278721 rows. I think this is a small forum, I suppose that there will be bigger forums out there. But you can see too, that the query time is very high (16sg). I have discarded another problem (very much visits, and so on).

Is there a way to increase the perfomance of this query?

Best regards and thanks in advance.

y2ksw 12-28-2012 09:17 AM

Quote:

Originally Posted by cylon1 (Post 2392784)
Dear friends:

This extension is amazing, I use it since months, and all works very well. The only problem is that, I'm using a vps with limited resources (apache, 512Mb ram). I've noticed that one of the slowest sql in my vps is the following:

Code:

# Query_time: 16.976461  Lock_time: 0.000214 Rows_sent: 0  Rows_examined: 278721
SET timestamp=1356435021;
SELECT postid, dateline, pagetext
        FROM post
        WHERE iei_parsed=0
            AND pagetext LIKE '%[/IMG]%'
        ORDER BY postid
        LIMIT 0, 5;

As you can see, my posts table has only 278721 rows. I think this is a small forum, I suppose that there will be bigger forums out there. But you can see too, that the query time is very high (16sg). I have discarded another problem (very much visits, and so on).

Is there a way to increase the perfomance of this query?

Best regards and thanks in advance.

Not that I can think of. A server should really ahve more than 512 MB of RAM, specially when using a database server, too. You may try to add some MB to the MySQL key buffer, but I doubt it will help.

y2ksw 12-28-2012 09:20 AM

Quote:

Originally Posted by Doganay YILDIZ (Post 2392220)
There is a problemmi? Pictures ftp uploading beautifully. However, I opened the new topics added almost 6 hours but still ftp. What's the problem?

I don't know. This product imports only external images which can be read by the server, using CURL or fopen. If it doesn't work for you, I'm sorry, but there is nothing I can do about.

destacamos 01-12-2013 05:33 PM

I installed this prodcut, but does nothing.

forum is installed in a subfolder:

www.website.com/forum

i create a folder images/imported to:

www.website.com/forum/images/imported

with 777 permissions

I uploaded the xml file, and nothing, when I put a picture in the forum does nothing.

for example I try this:
http://www.miblogdecineytv.com/image...ulas/Cars3.jpg

created a thread and put the image [IMG] Image [/IMG]

and still appears the url of miblogdecine .... and no create nothing in my server.

can anyone help me, please? thanks.

y2ksw 01-14-2013 09:12 PM

If it does nothing (please check with FTP in your imported folder), you system does not allow to pull in external data.


All times are GMT. The time now is 02:56 AM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.02172 seconds
  • Memory Usage 1,861KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (4)bbcode_code_printable
  • (25)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (4)pagenav_pagelink
  • (1)pagenav_pagelinkrel
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (40)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete