Log in

View Full Version : Administrative and Maintenance Tools - Import External Images


Pages : 1 [2] 3 4

y2ksw
09-05-2011, 08:41 PM
Probably the task is not running. If you turn logging on (edit the task) you should see at least a note.

If no images are downloaded, probably your server is locked against downloads or by disallowing fopen on URL's or by firewall.

DaffyDuck
09-06-2011, 05:27 AM
I turned on logging, made it manually run the task, and viewed the log - no entries.

Looks like the task is not running at all.

What now?

DaffyDuck
09-06-2011, 05:30 AM
I'm running version 1.02, by the way.

Had the same when having had version 1.04 or 1.05 installed.

Gemma
09-06-2011, 10:49 AM
Thanks for this :)

y2ksw
09-06-2011, 03:24 PM
I turned on logging, made it manually run the task, and viewed the log - no entries.

Looks like the task is not running at all.

What now?

I'm running version 1.02, by the way.

Had the same when having had version 1.04 or 1.05 installed.
No idea. If you have php logs somewhere, check if something is missing. Maybe the cronjob is disabled? Is the board off-line?

DaffyDuck
09-07-2011, 12:57 AM
Nope, board is up and running. As far as I can tell, all other cron jobs are running just fine. Even checked in the cron folder to make sure the iei file has right permissions and ownership set.

It wasn't originally, but even after I changed it to reflect the other scripts' ownerships, it still doesn't work.

Truly confusing.

What's even more startling is that months ago when I first had it running, it appears to have been working (the import/images folder is created and has prior files in it). It just seems that the actual script simply doesn't want to run.

Even deleting it and reinstalling it made no difference.

Really odd.

DaffyDuck
09-07-2011, 04:24 AM
Okay, I was able to verify that the script *does* execute :


Introduced an error in the script - script sticks. There's an obvious execution difference.

Remove the error, script seems to work. SO, we now know it executes the code, but the code does nothing.

Also, it generates an error in the general error log file, to verify that the introduced error was registered, and that the code was being executed otherwise:

[Tue Sep 06 22:22:59 2011] [error] [client 99.9.155.41] PHP Parse error: syntax error, unexpected T_STRING in /home/suaymac/public_html/includes/cron/iei_cron.php on line 24, referer: http://suaymac.com/suayadmincp/cronadmin.php?do=modify

Okay, so now what?

The script runs, but does nothing (or rather, not the intended behavior) - not quite sure what other places to look into.

DaffyDuck
09-07-2011, 08:22 PM
Update - updating to 1.05, and previously completely removing the older version, made it work. It performs as expected now. Yay!

Thanks for the help!

DaffyDuck
09-10-2011, 12:22 AM
One additional observation / request / question -- this script seems to work on the FORUM section, yet doesn't touch images in the CMS section. Is there some way to make it include those?

Scalemotorcars
10-06-2011, 03:43 PM
Ive noticed this is missing some photos. It seems images with this structure or at least from this site are not being imported.

http://www.hostingpics.net/viewer.php?id=335914DSC0001.jpg

This is my ignore list.

imgcache/
http://www.scalemotorcars.com/gallery/
http://www.ebay.com
http://thumbs4.ebaystatic.com/
http://thumbs3.ebaystatic.com/
http://thumbs2.ebaystatic.com/
http://thumbs1.ebaystatic.com/

Any ideal why?

Scalemotorcars
10-06-2011, 03:44 PM
One additional observation / request / question -- this script seems to work on the FORUM section, yet doesn't touch images in the CMS section. Is there some way to make it include those?

I would like to see this also.. :up:

y2ksw
10-07-2011, 07:51 AM
Ive noticed this is missing some photos. It seems images with this structure or at least from this site are not being imported.

http://www.hostingpics.net/viewer.php?id=335914DSC0001.jpgThis is my ignore list.



Any ideal why?
That's a HTML page and not an image :)

Scalemotorcars
10-07-2011, 12:25 PM
Since it only displays the actual image on my site is there still a way to import it?

nhawk
10-07-2011, 12:40 PM
Since it only displays the actual image on my site is there still a way to import it?

On your site, change the picture url to http://img11.hostingpics.net/pics/335914DSC0001.jpg

Scalemotorcars
10-07-2011, 04:59 PM
Forgive my ignorance but how exactly would I do that? Is it a white-list setting or ???

y2ksw
10-07-2011, 09:15 PM
On your site, change the picture url to http://img11.hostingpics.net/pics/335914DSC0001.jpg

Forgive my ignorance but how exactly would I do that? Is it a white-list setting or ???
You would do this with a query from phpmyadmin, such as:

UPDATE post SET pagetext=REPLACE(pagetext, 'http://www.hostingpics.net/viewer.php?id=', 'http://img11.hostingpics.net/pics/')

This can be time consuming and a server killer, but then you would be able to import the pictures normally. Maybe you will have to run this query locally with a very large timeout. It isn't however a guarantee to work, and the img11 suggests there are at least 11 different solutions for one problem ...

Normally you would first run a script to see if all the images are coming from the same server and then apply a global query which solves links in bunches.

Manoel J?nior
10-10-2011, 11:29 PM
Broker with images:

http://forumcom.detonaleech.com.br/files/John_Denver_-_Country_Roads-oN86d0CdgHQ_s.jpg

Not record the image, how to fix?

y2ksw
10-11-2011, 03:30 PM
Broker with images:

http://forumcom.detonaleech.com.br/files/John_Denver_-_Country_Roads-oN86d0CdgHQ_s.jpgNot record the image, how to fix?
There is no way to download images which need authorisation or which are hotlink-protected.

yahooooh
10-21-2011, 08:15 AM
Could you please make examples? I'm not sure what you want to have added.

i ask for adding thread url as link for image
when image is hosted and change the url address to my site
i want to make the image itself can be clicked with url of the thread itself

so if one copy the thread the images will be clicked to my forum thread

y2ksw
10-22-2011, 07:50 AM
i ask for adding thread url as link for image
when image is hosted and change the url address to my site
i want to make the image itself can be clicked with url of the thread itself

so if one copy the thread the images will be clicked to my forum thread
It already works this way. It copies the image to your site and renames the URL to the image. If somebody copies the message, they also copy the correct URL.

If, one day, you change your domain name, just reinstall the product and the images are reimported with the new domain name's URL (if the old domain is still accessible).

yahooooh
10-22-2011, 08:02 AM
It already works this way. It copies the image to your site and renames the URL to the image. If somebody copies the message, they also copy the correct URL.

If, one day, you change your domain name, just reinstall the product and the images are reimported with the new domain name's URL (if the old domain is still accessible).

i mean to make it clickable with link to the thread belong to it
to be for example the image been like this:
https://vborg.vbsupport.ru/ (https://vborg.vbsupport.ru/showthread.php?p=2260063#post2260063)

if you click the image it will be direct to the this thread
and only should be this if the original has not link to another site
that what i mean

y2ksw
10-22-2011, 06:15 PM
i mean to make it clickable with link to the thread belong to it
to be for example the image been like this:
http://www.vbulletin.org/custompics/forum/avatars/avatar39423_1.gif (https://vborg.vbsupport.ru/showthread.php?p=2260063#post2260063)

if you click the image it will be direct to the this thread
and only should be this if the original has not link to another site
that what i mean
I understand. However, it is such an additional feature which just serves you and nobody else. I take note about this request, but most probably it will not be implemented.

MyPeSePe
10-31-2011, 11:40 AM
I have all my pictures hosted on imageshack but tynipic or not the matter to my server

Sorry, was a technical failure, if I work

Ichigo88
11-14-2011, 08:40 PM
ciao y2ksw ho un problema! ho messo la 1.0.5 va bene! ma da qualche giorno ho problemi che in alcuni topic mostra immagini che non centrano con il contrnuto.
cioè mi spiego esempio se un topic ho messo una locandina di un albom ramazzotti, c'è il problema che l'immagine cambia e diventa altro.
non so se mi sono spiegato, a comunque non sono riuscito a capire sto problema.

thanks!

y2ksw
11-15-2011, 11:39 AM
ciao y2ksw ho un problema! ho messo la 1.0.5 va bene! ma da qualche giorno ho problemi che in alcuni topic mostra immagini che non centrano con il contrnuto.
cio? mi spiego esempio se un topic ho messo una locandina di un albom ramazzotti, c'? il problema che l'immagine cambia e diventa altro.
non so se mi sono spiegato, a comunque non sono riuscito a capire sto problema.

thanks!
what have you changed before you had the problem? :)

tarzan22
11-16-2011, 04:20 PM
4.1.8 ?

funciona

Manoel J?nior
11-16-2011, 05:21 PM
4.1.8 ?

funciona
Sim, funciona perfeitamente!!!!

Dave Hybrid
11-16-2011, 08:03 PM
Installed this on a very old site and it turned every image link into a dead url.

I can post a good image link, run the cron and it is zapped.

Because it edits the database it is irrecoverable.

Use with caution.

I'd love to hear if there is anyway to fully uninstall this, and reverse any changes it made it image urls, as at present, i have a forum full of dead images, 1000's of them.

Ichigo88
11-18-2011, 08:54 AM
what have you changed before you had the problem? :)
nothing :(

forse e dico forse ? stato quando ho resettato il database ad un giorni prima per? i file erano gli stessi e non del giorno prima. pu? essere? scusa se non parlo in inglese ma cos? mi spiego meglio, ripondi pure in inglese te non c'? problema.

y2ksw
11-18-2011, 11:23 AM
Installed this on a very old site and it turned every image link into a dead url.

I can post a good image link, run the cron and it is zapped.

Because it edits the database it is irrecoverable.

Use with caution.

I'd love to hear if there is anyway to fully uninstall this, and reverse any changes it made it image urls, as at present, i have a forum full of dead images, 1000's of them.
The description of the plugin tells what it does, and I always have reccomended to make backups, test and check before using in production. It solves widely known problems, but it may not be adeguate to use in all situations.

y2ksw
11-18-2011, 11:24 AM
nothing :(

forse e dico forse ? stato quando ho resettato il database ad un giorni prima per? i file erano gli stessi e non del giorno prima. pu? essere? scusa se non parlo in inglese ma cos? mi spiego meglio, ripondi pure in inglese te non c'? problema.
Italian support: www.vbulletin.it ;)

sticky
12-03-2011, 01:51 AM
For some reason this mod struggles with importing images from photobucket. This one would not import for example: http://i19.photobucket.com/albums/b156/a4ringedone8t/Turbo%20Z4M/IMG_7359R.jpg

y2ksw
12-03-2011, 09:01 AM
For some reason this mod struggles with importing images from photobucket. This one would not import for example: http://i19.photobucket.com/albums/b156/a4ringedone8t/Turbo%20Z4M/IMG_7359R.jpg
This may well be. Importing from a few sites has always been a problem, for example all those which block hot linking over time, or those which require to login. But it also has been proven not to work with too restrictive server settings, such as memory and timeout issues.

sticky
12-03-2011, 09:12 AM
This may well be. Importing from a few sites has always been a problem, for example all those which block hot linking over time, or those which require to login. But it also has been proven not to work with too restrictive server settings, such as memory and timeout issues.
So no way to get this to work for that image?

It isn't the server...

y2ksw
12-04-2011, 11:03 AM
I don't believe there is anything we can do.

Alfa1
12-06-2011, 11:46 PM
I'd like to suggest a feature for a future release:

Import the image into a profile album of the post owner.

Przemoo
12-20-2011, 02:05 AM
how to set this up to send images into different server than forum ? i've got low bandwith and wish to have all pistures on different host, is that possible?

y2ksw
12-20-2011, 08:23 AM
how to set this up to send images into different server than forum ? i've got low bandwith and wish to have all pistures on different host, is that possible?
Yes. But it needs your own system to move the files from the forums to another place and quite some extra settings which you should first try in a test bed. If you search for fsftp or ftpfs in this thread, you'll get some ideas how to do this.

kingMOB
12-20-2011, 12:32 PM
I'd like to suggest a feature for a future release:

Import the image into a profile album of the post owner.

This would be really nice =)

Manoel J?nior
01-24-2012, 11:41 PM
Please, help-me!!

My images stopped being imported, or rather they are imported but they are in my FTP with nomenclature: 3391.attach.pl_cached not 3391.imgcache

How can I do to fix this?

y2ksw
01-25-2012, 09:09 PM
Please, help-me!!

My images stopped being imported, or rather they are imported but they are in my FTP with nomenclature: 3391.attach.pl_cached not 3391.imgcache

How can I do to fix this?
I have no idea how this could happen. Do you have a symbolic link or mount point to a different volume?

Manoel J?nior
01-25-2012, 09:22 PM
I have no idea how this could happen. Do you have a symbolic link or mount point to a different volume?
I do not know! I did the following test:

1. I changed the location of storage of images, I gave permission 777
2. I created a new topic with a picture
3. I went on FTP, the new folder, and he created the folder and subbasta, but with the year 2011, and within that folder there is no file.

What steps can I take to resolve this problem?

y2ksw
01-26-2012, 04:23 PM
Was the picture publically accessible? For example, if you paste an image from your desktop, Apache is not able to read it and ignores it. Also, if the image is a dynamic URL or the location needs passwords, you may see the images but Apache not.

Manoel J?nior
01-26-2012, 04:45 PM
Was the picture publically accessible? For example, if you paste an image from your desktop, Apache is not able to read it and ignores it. Also, if the image is a dynamic URL or the location needs passwords, you may see the images but Apache not.
Hello y2ksw,

From what I can gather is that this file that you've (3391.attach.pl_cached) relates to the attachments, so please disregard that part.

What is happening is that it creates the directory, but does not create the files. As an example I quoted my post above:

1. I changed the location of storage of images, I gave permission 777
2. I created a new topic with a picture
3. I went on FTP, the new folder, and he created the folder and subdirectory, but with the year 2011, and within that folder there is no file.

I found it strange that instead of creating the directory in 2012 he created the directory 2011.

In keeping with this structure:

./imgcache/2011/03 /

And inside the directory there is nothing, but he created the directory and subdirectory.

Thanks for you help!!!!

y2ksw
01-26-2012, 06:41 PM
Could you please try to create a file from a script in that folder and see what rights it has (or what errors):

<?php
$fp = fopen('imgcache/2011/03/test.file', 'wb');
fwrite($fp, 'abc');
fclose($fp);

echo file_get_contents('imgcache/2011/03/test.file');
die;
?>

Manoel J?nior
01-28-2012, 05:10 PM
Could you please try to create a file from a script in that folder and see what rights it has (or what errors):

<?php
$fp = fopen('imgcache/2011/03/test.file', 'wb');
fwrite($fp, 'abc');
fclose($fp);

echo file_get_contents('imgcache/2011/03/test.file');
die;
?>
It created the file perfectly content with abc

What could be wrong? Very thanks for you help!

temsamane
01-30-2012, 02:16 PM
is this working for 4.1.10?

y2ksw
01-30-2012, 07:05 PM
It created the file perfectly content with abc

What could be wrong? Very thanks for you help!
What was the reason for which you changed the previous folder to another? Are the foldernames syntactically the same?

I mean:
/abc = /def
but not:
/abc <> ./def/

y2ksw
01-30-2012, 07:06 PM
is this working for 4.1.10?
Yes :)

Manoel J?nior
01-30-2012, 11:20 PM
What was the reason for which you changed the previous folder to another? Are the foldernames syntactically the same?

I mean:
/abc = /def
but not:
/abc <> ./def/
I have not changed, has always been this directory. What I meant earlier, that he should have created a new folder with the year 2012, would not it?

y2ksw
01-31-2012, 09:46 AM
I have not changed, has always been this directory. What I meant earlier, that he should have created a new folder with the year 2012, would not it?
If you didn't change the folder and it worked before and not now any more, maybe your provider changed something beyond our accessibility, such as, for example, the memory allocation for PHP scripts. There is no way to know, for me, what could have happened.

In a specific case before we made any imaginable efford to find out why, giving eventually up. And this is for me yet final. If the plugin does not work, there is nothing I can do about it.

merkaz
02-17-2012, 03:53 PM
nice mod thanks ...

It will be better if there is away to make it run for only first post in the thread ..

I think there is no need to check all forum post ...

merkaz
02-17-2012, 11:50 PM
MySQL error :

Database error in vBulletin 4.1.6:

Invalid SQL:
INSERT IGNORE INTO iei_img (
oldurl,
newurl
) VALUES (
'http://>............/web/img/200907141558550.200905101539340_Damascus.jpg',
'http://............./clear.gif'
);

MySQL Error : MySQL server has gone away
Error Number : 2006

Nirjonadda
02-20-2012, 05:10 PM
Installed working fine with 4.1.10

merkaz
02-22-2012, 01:37 PM
It works fine .. the mod finishes the all posts on my site 2005, 2006 , 2007 , 2008 , 2009 , 2010 and 2011 .. it stoped in 1/2012 why ?

its not working on this month posts ..

merkaz
02-23-2012, 03:33 AM
there are many posts with images in my forum and the images is works and valid .. this mod Replaced these iamges with the clear.gif ...

even if " Remove Invalid Images " set to no .. this mod remove these images so now I have alot of posts without images ...

too bad I didn't know this until now ..

the post before the mod work :
136631
after
136632

the images on my forum is gone awaaaaay :(

y2ksw
02-25-2012, 10:12 AM
It works fine .. the mod finishes the all posts on my site 2005, 2006 , 2007 , 2008 , 2009 , 2010 and 2011 .. it stoped in 1/2012 why ?

its not working on this month posts ..
Maybe the question is, what has changed at your hosting plan from then to now.

y2ksw
02-25-2012, 10:16 AM
MySQL error :

Database error in vBulletin 4.1.6:

Invalid SQL:
INSERT IGNORE INTO iei_img (
oldurl,
newurl
) VALUES (
'http://>............/web/img/200907141558550.200905101539340_Damascus.jpg',
'http://............./clear.gif'
);

MySQL Error : MySQL server has gone away
Error Number : 2006
Going backwards your requests, this one shows the database server timed out before the image could be handled. Please fix first your server!

y2ksw
02-25-2012, 10:17 AM
nice mod thanks ...

It will be better if there is away to make it run for only first post in the thread ..

I think there is no need to check all forum post ...
Until now, we all need the importation of all images ;)

y2ksw
02-25-2012, 10:45 AM
there are many posts with images in my forum and the images is works and valid .. this mod Replaced these iamges with the clear.gif ...

even if " Remove Invalid Images " set to no .. this mod remove these images so now I have alot of posts without images ...

too bad I didn't know this until now ..

the post before the mod work :
136631
after
136632

the images on my forum is gone awaaaaay :(
First, make sure to clear the post cache if you have any (truncate table: 'postparsed'). And maybe this will solve also other problems.

If you have a backup, you may replace the old posts:

Change the queries from 'INSERT INTO' to 'REPLACE INTO' from the 'post' table only. Also, consider to uninstall the plugin first (reason: additional field in post table). Of course, if users have edited their posts, they are overwritten by the restore. Thus, consider to make another backup before restore ;)

Finally, the product is running quickly through all posts unless the post count is very small or the interval very large. If your server is setup to allow download documents via CURL, there should be no issue, however, if there are issues with downloading you would have find out when testing.

clutchthese
02-28-2012, 12:02 AM
This replaces and .gif images with .jpg images, even when "don't convert to .jpg" is selected.

Is there anything you can do to allow this to work with .gifs?

temsamane
02-28-2012, 01:30 PM
it there any update for last vb version?

is this mod slowing down the forum?

y2ksw
02-28-2012, 02:52 PM
This replaces and .gif images with .jpg images, even when "don't convert to .jpg" is selected.

Is there anything you can do to allow this to work with .gifs?
Can you make us a snapshot of your settings?

y2ksw
02-28-2012, 02:54 PM
it there any update for last vb version?

is this mod slowing down the forum?
I have it running on 4.1.10.

And yes, it may slow down a little the forum. For this reason you may adjust he number of posts to parse and also setup manually the period when parsing should happen (cronjobs).

clutchthese
02-28-2012, 09:28 PM
Can you make us a snapshot of your settings?

No problem....


https://vborg.vbsupport.ru/external/2012/02/8.png

https://vborg.vbsupport.ru/external/2012/02/9.png

sarangan
03-02-2012, 12:39 PM
New Feature request:

Problem: My forum is targetted by many spammers at this time. For that reason I moderate all new threads before showing to public. For 2 days ago a spammer posted 50 threads in my forum with about 50x30 = 1500 porn images. The problem was this plugin imported all those images.. Even I deleted all those spam threads, images are still in folder. :-(

Solution:
Adding an option to only begin to import images for approved threads. It should wait until a thread is approved by a mod or admin. Is this possible? If so, I'm looking forward to have this option implemented in this plugin.

Thanks for a really wonderful plugin which helped me a lot from having broken images.

Rckcrwlr
03-04-2012, 11:25 AM
I need to add something like this due to the amount of images that are pertinent to the subject of the forum.

If it does not work, is there a way to get it back to original. I will back it up.

Is there a way to "test" it prior to flicking the switch?

y2ksw
03-05-2012, 08:22 AM
New Feature request:

Problem: My forum is targetted by many spammers at this time. For that reason I moderate all new threads before showing to public. For 2 days ago a spammer posted 50 threads in my forum with about 50x30 = 1500 porn images. The problem was this plugin imported all those images.. Even I deleted all those spam threads, images are still in folder. :-(

Solution:
Adding an option to only begin to import images for approved threads. It should wait until a thread is approved by a mod or admin. Is this possible? If so, I'm looking forward to have this option implemented in this plugin.

Thanks for a really wonderful plugin which helped me a lot from having broken images.
This product is not intended to solve a lot of problems, but only one: avoid loosing hot-linked images forever. I understand there may be spam related and other problems, but a lot of additional options are also always a source of additional problems which I am unable to follow up.

y2ksw
03-05-2012, 08:23 AM
I need to add something like this due to the amount of images that are pertinent to the subject of the forum.

If it does not work, is there a way to get it back to original. I will back it up.

Is there a way to "test" it prior to flicking the switch?
You should try it first in a copy or test forum. Also, backups are always a good idea. Thre is no switch to try. It's on or off :)

clutchthese
03-05-2012, 11:28 AM
Do you have any idea about the .gif's? I really like this mod, but don't want it to copy the .gif images as jpg... they're not animated after saving to server.

sarangan
03-05-2012, 11:38 AM
Do you have any idea about the .gif's? I really like this mod, but don't want it to copy the .gif images as jpg... they're not animated after saving to server.

It's because you setted option "Always Convert Images" to yes. Set it No if you don't want gifs to be converted to jpg.

clutchthese
03-05-2012, 11:40 AM
No, i don't have that selected. It's set to no.

BirdOPrey5
03-05-2012, 11:49 AM
Mine keeps gifs as gifs... always has.

y2ksw
03-05-2012, 02:42 PM
No, i don't have that selected. It's set to no.
If you have scaling enabled and the image needs resizing, it is converted to jpg too, because gif animations would get lost anyways.

clutchthese
03-05-2012, 10:08 PM
^^That's good to know. Thank you for that! :)

BadgerDog
03-15-2012, 12:35 PM
We're running vBulletin 4.1.3pl5 and current version of Import External Images ?

Has anyone experienced problems with standard IMG code not being able to open a pic that exists and is properly stored on the server?

I've had reports of members saying all they get in a thread is a "Not Found" error, when in fact the pic is store properly on the server and can be displayed by cutting and pasting the link into the browser directly.

When I use "Firebug" in FireFox to check the code execution, I get this...

<img border="0" alt="" src="http://www.xxxxx.com/images/imported/2012/03/M14-1.jpg" original="http://www.xxxxx.com/images/imported/2012/03/M14-1.jpg" style="">

... but, it's highlighted in RED and says it "Failed to load the given URL"? :confused:

Note that the filename displayed by Firebug diagnostics that it says vBulletin's standard HTML code is seeing is M14-1.jpg (upper case M) when in fact the file is stored on the Unix server as m14-1.jpg (lower case m) and the IMG code in the actual post refers to is as m14-1.jpg (lower case m). So, for whatever reason, somehow the filename is being converted to an UPPER case and so it doesn't match.

It appears to just be happening with pics in the last month or so.

Interestingly enough, if I change the filename on the server to m141.jpg and also edit the post and change the IMG reference to m141.jpg, it displays fine .... :eek:

Regards,
Doug

ps: I substituted XXX's in the link above for privacy and security reasons .. ;)

mescalin
03-15-2012, 01:19 PM
Perfect plugin and a great idea! This plugin can also have a cron to delee unused images anymore. In example it can run cron to check if there is a link to that pic in db and if not it deletes them. Its a great plugin.

BadgerDog
03-15-2012, 01:26 PM
This plugin can also have a cron to delee unused images anymore. In example it can run cron to check if there is a link to that pic in db and if not it deletes them. Its a great plugin.

That would be a great add-on.... can anyone write something like that?

Regards,
Doug

BadgerDog
03-15-2012, 04:49 PM
Reference post #326 ....

Problem fixed .... :)

Thanks ...

Regards,
Doug

y2ksw
03-15-2012, 09:03 PM
We're running vBulletin 4.1.3pl5 and current version of Import External Images ?

Has anyone experienced problems with standard IMG code not being able to open a pic that exists and is properly stored on the server?

I've had reports of members saying all they get in a thread is a "Not Found" error, when in fact the pic is store properly on the server and can be displayed by cutting and pasting the link into the browser directly.

When I use "Firebug" in FireFox to check the code execution, I get this...

<img border="0" alt="" src="http://www.xxxxx.com/images/imported/2012/03/M14-1.jpg" original="http://www.xxxxx.com/images/imported/2012/03/M14-1.jpg" style="">

... but, it's highlighted in RED and says it "Failed to load the given URL"? :confused:

Note that the filename displayed by Firebug diagnostics that it says vBulletin's standard HTML code is seeing is M14-1.jpg (upper case M) when in fact the file is stored on the Unix server as m14-1.jpg (lower case m) and the IMG code in the actual post refers to is as m14-1.jpg (lower case m). So, for whatever reason, somehow the filename is being converted to an UPPER case and so it doesn't match.

It appears to just be happening with pics in the last month or so.

Interestingly enough, if I change the filename on the server to m141.jpg and also edit the post and change the IMG reference to m141.jpg, it displays fine .... :eek:

Regards,
Doug

ps: I substituted XXX's in the link above for privacy and security reasons .. ;)
That sounds very strange to me. Not even a system or web server issue, IMHO. Do you have other plugins installed which may interfere with images? Like image resizers?

y2ksw
03-15-2012, 09:05 PM
Perfect plugin and a great idea! This plugin can also have a cron to delee unused images anymore. In example it can run cron to check if there is a link to that pic in db and if not it deletes them. Its a great plugin.

That would be a great add-on.... can anyone write something like that?

Regards,
Doug
I took note. This suggestion also contains the perfect solution :)

y2ksw
03-15-2012, 09:07 PM
Reference post #326 ....

Problem fixed .... :)

Thanks ...

Regards,
Doug
Okay :)

BadgerDog
03-15-2012, 10:33 PM
Okay :)

Conflict with Autolinker mod, which is doing something to filenames as it reads them in from server.

Your import mod is working just fine... great mod and in my opinion, one of the most useful I've ever installed for vBulletin ... glad I donated PayPal to you to say thanks ... love to see the auto cleanup of pics that aren't in database, if you get some time.

I'd donate again to add that capability, even as s separate cron job....

Regards,
Doug

Kenas
03-18-2012, 01:53 PM
Hi i installed this addonon 15th and some of my images till that day have been parsed successfully but when i get back to my ftp i cant see any new image being parsed since that day. And there are many images that havent been parsed.
this is my site http://www.gsmforum.es/

y2ksw
03-19-2012, 12:45 AM
Hi i installed this addonon 15th and some of my images till that day have been parsed successfully but when i get back to my ftp i cant see any new image being parsed since that day. And there are many images that havent been parsed.
this is my site http://www.gsmforum.es/
The images which can't be found are not imported. Some sites block hot-linking or have URL's which can't be read properly as an image and remain untouched.

However it sounds more like a permission issue. If you have for example cPanel, please check that there is no automatism such as changing rights to files and folders. Also, it is likely you have changed the permissions by coincidence ;)

Kenas
03-22-2012, 11:54 PM
The images which can't be found are not imported. Some sites block hot-linking or have URL's which can't be read properly as an image and remain untouched.

However it sounds more like a permission issue. If you have for example cPanel, please check that there is no automatism such as changing rights to files and folders. Also, it is likely you have changed the permissions by coincidence ;)

It only happens with one site that my rss feeds are importing. is there anyway to import those hot-linking ?
If i open the image in the browser i can see that image in my forum (but only in my pc & only on the same browser) i dont mind to import that image to my forum/host.
Tyvm for your reply really very usefull

At first i did thought it was permission issues so i checked with a different site and was working perfectly and ur mod too ^^ ;) Good Job !

y2ksw
03-23-2012, 10:36 AM
It only happens with one site that my rss feeds are importing. is there anyway to import those hot-linking ?
If i open the image in the browser i can see that image in my forum (but only in my pc & only on the same browser) i dont mind to import that image to my forum/host.
Tyvm for your reply really very usefull

At first i did thought it was permission issues so i checked with a different site and was working perfectly and ur mod too ^^ ;) Good Job !
There is no way to predict how hot-linking is detected. The current system does a good job, but it can't try all possible ways, because it esentially doesn't know to which site it connects, and still, it can't guess which domain and/or page must be refferred in order to see the images.

yousefz
04-05-2012, 09:36 AM
Hello,

Can not download the file ?!

BirdOPrey5
04-05-2012, 11:33 AM
Hello,

Can not download the file ?!

Please try again. It may have been a temporary forum issue.

oldlock
04-05-2012, 10:25 PM
Does the resize function in the mod force the creation of thumbnails in the normal vb manner ? If not is there anyway to create thumbnails and place them in the posts as the importation takes place ?

mescalin
04-06-2012, 01:34 AM
I there a planned update for a cronjob for deleting unused files?

y2ksw
04-06-2012, 12:36 PM
Does the resize function in the mod force the creation of thumbnails in the normal vb manner ? If not is there anyway to create thumbnails and place them in the posts as the importation takes place ?

No. This plugin imports only images and stores them on the file system instead of hot-linking.

I there a planned update for a cronjob for deleting unused files?

Yes. But I have no idea when.

y2ksw
04-06-2012, 01:42 PM
*** FOR LINUX EXPERTS ONLY ***

WARNING: If you don't trust me (you shouldn't) or yourself, please try this first in a virtual box or fail-proof test environment. It is entirely up to you to verify this working properly. If you are not a Linux expert, you probably are better off with asking some help!

Many users of this plugin have asked, how to move their images from one place to another, preferably by using a FTP connection to their media server. This guide will show you how to install a local mount point to a remote server via FTP. I have tried this on two Linux Ubuntu 10.04 LTS production boxes, one holding the mount and the other keeping the images and, mainly, large videos.

All you need is a media server (may be a Windows server, as well) at some place with a FTP connection, and a Linux web server. On Linux Ubuntu you would issue a:

# aptitude install curlftpfs

but on other systems you may use apt-get, yum or rpm. All what matters is installing curlftpfs.

Once installed, you would create typically a new directory, but for moving files from one place to another, you would use just "the one" folder you already have, for example:

/var/www/domain.tld/htdocs/images/imported

The imported folder would typically hold hundreds or thousands of large files, which you would like to move elsewhere. First, you would now move or copy all files to the new server destination, and then create the FTP mount point as follows:

# curlftpfs -o allow_other,nonempty ftp_user:ftp_password@your.media.server/anywhere/you/want/ /var/www/domain.tld/htdocs/images/imported

If you have an empty folder now, you would not need to specify nonempty, thus issue:

# curlftpfs -o allow_other ftp_user:ftp_password@your.media.server/anywhere/you/want/ /var/www/domain.tld/htdocs/images/imported

ftp_user is the username and ftp_password the password to connect to your media server. Since passwords are clear, make sure to use passwords different from your root account "here" and/or "there". your.media.server would be your host name for all the files and folders, and an optional /anywhere/you/want/ would indicate a subfolder on the "other" machine. /var/www/domain.tld/htdocs/images/imported indicates the mount point. It makes no difference with or without a leading slash of your folders.

If everything went right, you are now able to play with your FTP connection, which essentially behaves as a normal folder:

# cd /var/www/domain.tld/htdocs/images/imported
# ls -lA
# mkdir abc
# touch abc.txt
# ls -lA
# df -h
# umount /var/www/domain.tld/htdocs/images/imported
# mount /var/www/domain.tld/htdocs/images/imported

and so on. Somebody now starts to dream ... what a great connection :)

Now, we have to add this feature to the fstab in order to have this feature always available. If the remote server isn't available at (re)boot time of this server, obviously the mount will not work. We open /etc/fstab and add this line at the end:

curlftpfs#ftp://ftp_user:ftp_password@your.media.server/anywhere/you/want/ /var/www/domain.tld/htdocs/images/imported fuse defaults 0 0

Now, you would typically add a redirect to your .htaccess file from your normal image folder to your media server. Of course, it must have a web server, too, eventually at the specified location:

RedirectMatch ^/images/imported/(.*) http://your.media.server/anywhere/you/want/$1

At your media server you may monitor the new function by watching your log, for example:

# tail -f /var/www/your.media.server/weblogs/access.log

curlftpfs offers a whole lot of additional features, including SSH, proxy and write protection, which may e useful in come contexts. Also, please make sure to exclude the mount point from your round-robin rsync or your backup, since rsync and backup may pull in a lot more traffic than expected.

mescalin
04-20-2012, 11:43 PM
My users are adding some links like 11234.jpg?uuygyug

This question mark after the variable prevents mod from importing. it seems as imported but no such file found. So images goes missing. Any idea about fixing this?

Edit: ? in filename becomes .jpg%3 but in the post link to image is still like .jpg?

Thank you..

y2ksw
04-21-2012, 09:35 AM
My users are adding some links like 11234.jpg?uuygyug

This question mark after the variable prevents mod from importing. it seems as imported but no such file found. So images goes missing. Any idea about fixing this?


Edit: ? in filename becomes .jpg%3 but in the post link to image is still like .jpg?

Thank you..
Enable the "Always Convert Images" option. This way, all images are converted to jpg files and accordingly renamed.

How filenames are translated depend on the operating system. On Linux for example, the ? symbol remains, but still could not be found, because ? is a HTML query on most systems.

mescalin
04-21-2012, 11:00 AM
i thought about renaming and converting options but if i convert all images animated gifs will not work i guess?

if i enable rename files option only, can it fix that problem?

y2ksw
04-21-2012, 12:09 PM
i thought about renaming and converting options but if i convert all images animated gifs will not work i guess?

if i enable rename files option only, can it fix that problem?
This will do (= Use Original File Names: No) :)

mescalin
05-10-2012, 09:42 PM
its me again.. :)

in my forums some pics are replaced with wrong images that are allready in imported folder. Product does not import these images but replaces them with nonrelated existing pics.

i tried several different settings but couldnt prevent that behaviour. Any idea what can i do?

Ps its a rare behaviour. I have about 1,5m posts but it doesnt happen very often..

rgreene1971
05-12-2012, 11:55 PM
Would it be possible to use this to import images from an old smf 2.0.2 forum? The old forum is still on my server at location www.mysite.com/forums with my new running vb4 forum at www.mysite.com/vbforum

This would be a great way to slowly import all my images from the old site

y2ksw
05-14-2012, 06:19 PM
its me again.. :)

in my forums some pics are replaced with wrong images that are allready in imported folder. Product does not import these images but replaces them with nonrelated existing pics.

i tried several different settings but couldnt prevent that behaviour. Any idea what can i do?

Ps its a rare behaviour. I have about 1,5m posts but it doesnt happen very often..
I believe this may be a DNS related problem.

y2ksw
05-14-2012, 06:20 PM
Would it be possible to use this to import images from an old smf 2.0.2 forum? The old forum is still on my server at location www.mysite.com/forums (http://www.mysite.com/forums) with my new running vb4 forum at www.mysite.com/vbforum (http://www.mysite.com/vbforum)

This would be a great way to slowly import all my images from the old site
If the images are publically accessible it should work. Please try first with a test environment :)

cylon1
05-24-2012, 03:49 PM
This plugin works very well, but it fails sometimes.

FOr example, importing images from facebook. Yo can have a try with the following image:

https://fbcdn-sphotos-a.akamaihd.net/hphotos-ak-ash3/564869_295732153850251_256049164485217_655088_2984 86535_n.jpg


It only inserts the clear.gif image. No errors in the server logs, in the vbulletin logs...

ANy solution?

Thanks in advance

y2ksw
05-25-2012, 05:05 AM
This plugin works very well, but it fails sometimes.

FOr example, importing images from facebook. Yo can have a try with the following image:

https://fbcdn-sphotos-a.akamaihd.net/hphotos-ak-ash3/564869_295732153850251_256049164485217_655088_2984 86535_n.jpg


It only inserts the clear.gif image. No errors in the server logs, in the vbulletin logs...

ANy solution?

Thanks in advance
Disable the option where to replace invalid images. Then you keep all of the images which for one reason or another don't import.

Nirjonadda
05-26-2012, 03:23 PM
its me again.. :)

in my forums some pics are replaced with wrong images that are allready in imported folder. Product does not import these images but replaces them with nonrelated existing pics.

i tried several different settings but couldnt prevent that behaviour. Any idea what can i do?

Ps its a rare behaviour. I have about 1,5m posts but it doesnt happen very often..

Its same problem for me ... any solution please?

chimpmaster
05-28-2012, 12:25 AM
!http://website...photo1.jpg?w=768&h=1024 (defaults to image #1 in the directory)

!http://website...photo1.jpg (works)

Some sites add trailing info to the image for sizing. Can the program remove that extra info?

Installed on V 4.1.12 and working great. Any thoughts on adding this feature to external signature images? Thanks.

y2ksw
05-28-2012, 06:11 AM
Its same problem for me ... any solution please?
I believe it's a DNS/server problem and thus there is no other solution than trying another service or not using the plugin.

The product currently works on several large sites with thousands of images imported each month and none of them had ever such a problem.

nexxzus
06-22-2012, 05:30 PM
It runs on vbulletin 4.2?

Gemma
06-22-2012, 05:36 PM
It runs on vbulletin 4.2?

Yes

Old-Git
07-21-2012, 12:01 AM
Tried in on VB4.2.0 PL 2 this evening and couldn't get it to work at all. The code seemed to run but the Cron job did not. I tried to run it manually and it just hung on a grey screen which said, on upper left corner, VB External Image Importer (or words to that effect). Turned on logging and there was nothing in the logs, tried again, same thing nothing in the logs. FTP to server and looked at the Images/imported folder and seen that it had created 2011 folder and two folders under that one named 01 and the other named 11. Nothing in either folder.

I uninstalled and re-installed, making sure to overwrite, and still the same problem. I tried to uninstall again and this time the uninstall routine hung on a grey screen. Disabled and tried to unisntall and still hung on the grey screen. Diasbled all plugins globally and tried to uninstall, still hung on grey screen. Disabled cron job and tried to unistall and still hung on grey screen. Re-enabled global plugins and then disabled all individual plugins and tried to uninstall. Still hung on grey screen. Finally, re-installed and overwrote (again) and immediately went to uninstall and finally removed it from site. It sounds lovely and now that I can choose which forums I want to include in the import process it would be brilliant if it would work for me.

Incidentally fopen on URL's is on and there's no firewall blocking downloads (I tried your test.php file for google from way back in the middle of this thread....yeah I read the whole thread looking for answers).

Thankfully I was running this on my test rig here in my office and not on my live server so I was'nt worried about all the issues. I'm off to bed now, it's 2:00 am here in the UK, and I'll have another run at this tomorrow.

Rgds

Pete

PS anyone have any success in running it on a 4.2.0 Pl2 install?

Old-Git
07-21-2012, 01:50 PM
Has no-one go this working on 4.2.0 PL2? Are there any plans to release an upgrade for this hack?

BirdOPrey5
07-21-2012, 02:10 PM
I'm not using this mod on my 4.2.0 site but honestly being familiar with the code I can't see any reason this shouldn't work in 4.2.0.

y2ksw
07-21-2012, 03:47 PM
Tried in on VB4.2.0 PL 2 this evening and couldn't get it to work at all. The code seemed to run but the Cron job did not. I tried to run it manually and it just hung on a grey screen which said, on upper left corner, VB External Image Importer (or words to that effect). Turned on logging and there was nothing in the logs, tried again, same thing nothing in the logs. FTP to server and looked at the Images/imported folder and seen that it had created 2011 folder and two folders under that one named 01 and the other named 11. Nothing in either folder.

I uninstalled and re-installed, making sure to overwrite, and still the same problem. I tried to uninstall again and this time the uninstall routine hung on a grey screen. Disabled and tried to unisntall and still hung on the grey screen. Diasbled all plugins globally and tried to uninstall, still hung on grey screen. Disabled cron job and tried to unistall and still hung on grey screen. Re-enabled global plugins and then disabled all individual plugins and tried to uninstall. Still hung on grey screen. Finally, re-installed and overwrote (again) and immediately went to uninstall and finally removed it from site. It sounds lovely and now that I can choose which forums I want to include in the import process it would be brilliant if it would work for me.

Incidentally fopen on URL's is on and there's no firewall blocking downloads (I tried your test.php file for google from way back in the middle of this thread....yeah I read the whole thread looking for answers).

Thankfully I was running this on my test rig here in my office and not on my live server so I was'nt worried about all the issues. I'm off to bed now, it's 2:00 am here in the UK, and I'll have another run at this tomorrow.

Rgds

Pete

PS anyone have any success in running it on a 4.2.0 Pl2 install?

Has no-one go this working on 4.2.0 PL2? Are there any plans to release an upgrade for this hack?
Have you checked the permissions? Please check that the newly created folders have the right to modify (chmod 755 at least) for the server process. If the server can create the folders, but can't assign the rights to change contents, all effords are in vain.

There are currently no plans to upgrade.

Old-Git
07-21-2012, 04:42 PM
Just tried it again with 1.0.4. The cron job still doesn't seem to want to run on it's own but when I run it manually it now completes. However, it's not even creating the sub-directories in Images/Imported and obviously it's not touching any of the images at all.

permissions on the folders have been set to both 755 and 777. It simply doesn't seem to want to work on 4.2.0. PL2. I've wasted enough time on it so I've uninstalled it and will come back to it after others have tried and confirmed it works on 4.2.0 PL2.

warlord0
07-26-2012, 10:13 AM
Hmm, just working on this and can't see it doing anything. Using 1.0.5 on vb4.2.0 PL2

# ls -l /var/www/forum/images/
drwxrwxrwx 2 nginx nginx 4096 Jul 26 11:46 imported

# ls -l /var/www/forum/includes/cron/
-rwxrwxrwx 1 nginx nginx 16607 Jul 26 11:43 iei_cron.php

Nothing getting created in the imported folder.

I have set it so it only includes forum ID 121 in the options and left the exclude empty.

warlord0
07-26-2012, 10:16 AM
Actually it IS doing something.

I query the iei_img table I see it has the newurl and old url, but it isn't fetching the image. If I try the newurl I get a 404.

phpinfo:
cURL support enabled
cURL Information 7.21.0
Age 3
Features
AsynchDNS No
Debug No
GSS-Negotiate Yes
IDN Yes
IPv6 Yes
Largefile Yes
NTLM Yes
SPNEGO No
SSL Yes
SSPI No
krb4 No
libz Yes
CharConv No
Protocols dict, file, ftp, ftps, http, https, imap, imaps, ldap, ldaps, pop3, pop3s, rtsp, scp, sftp, smtp, smtps, telnet, tftp
Host x86_64-pc-linux-gnu
SSL Version OpenSSL/0.9.8o
ZLib Version 1.2.3.4
libSSH Version libssh2/1.2.6

warlord0
07-26-2012, 10:40 AM
All sorted forget I was even here.

I think it all came down to it running the scheduled task before the permissions were correct. Then it wouldn't refetch the image.

After I got a new post with new image up it worked fine.

BadgerDog
07-26-2012, 11:34 AM
Donated PayPal to author and been using this terrific mod for a year or so now and it's great !!!

Running 4.1.3pl5 ...

We've come across something weird with it I can't figure out. A member referenced 5 JPG pics (all under 100k in size) using IMG bbcode and pointing to PhotoBucket.

y2ksw's excellent import mod executed it's scheduled task and imported 3 of them just fine ...

FR8002 imported as FR8002-1
FR8003 imported as FR8003-1
FR8004 imported as FR8004-1

It refused to import 2 of them titled:

FR-8001
FR-8005

With the first 3, a typical edit post showed links like this, as they are stored on our own server:

http://www.xxxx.com/images/imported/2012/07/FR8002-1.jpg
http://www.xxxx.com/images/imported/2012/07/FR8003-1.jpg
http://www.xxxx.com/images/imported/2012/07/FR8004-1.jpg

The same edited post shows links to where the two that didn't post as:

http://www.xxxx.com/ (Note: no reference to a pic at all)

There's nothing abnormal about the two pics that this mod fails to process, except they have a "-" dash character as the second character of the filename.

In order to get the pics to show for our member, I had to manually upload for the two of them from PhotoBucket into the imported directory and they display properly in vBulletin doing that. However, all testing I've done with test posts, consistently causes the import mod to fail on these two pics.

Anyone have any idea what's happening? :confused:

Is it possible that the "-" in the filename is causing a problem with this mod?

Thanks for any feedback ... :)

Regards,
Doug

imported_dfmafia
07-26-2012, 07:38 PM
Just tested this on my vB 4.2.0 PL2 suite. It's a no-go for all 3 versions.

The cron job never runs. It says it does complete. No scheduled task is run for Import Export Images. Directories have correct permissions.

nothing imported, no scheduled task in the log even if ran manually and it says DONE like it performed its task successfully

y2ksw
07-27-2012, 05:43 AM
All sorted forget I was even here.

I think it all came down to it running the scheduled task before the permissions were correct. Then it wouldn't refetch the image.

After I got a new post with new image up it worked fine.
I'm glad you have fixed it yourself; all I could have suggested, was to check the permissions :)

y2ksw
07-27-2012, 05:57 AM
Just tested this on my vB 4.2.0 PL2 suite. It's a no-go for all 3 versions.

The cron job never runs. It says it does complete. No scheduled task is run for Import Export Images. Directories have correct permissions.

nothing imported, no scheduled task in the log even if ran manually and it says DONE like it performed its task successfully
It surely did compete successfully. The "done" stands for: non syntax errors, no halt, non technical problem. There can be many other issues though, beginning with CURL, fopen & URL's, wrong settings. Many things.

The product is designed to work with most configurations without blocking the board. If nothing happens, please re-check the permissions. Most of the times the problems are permission problems (even though everything seemed ok), but we have had also memory related problems with huge images ... but then it wouldn't arrive at Done ;)

As told so many times before, if Apache (or any other server) can't access the folders for rwx it may however be able to create, nothing will happen. On a Linux environment, Apache should run as www-data (33:33) and jail PHP into a web space. FTP should then have the same access rights as Apache (33:33) and then magically all server problems disappear.

Whenever you have a situation where FTP has different rights than the web server, and the web server rights are not enough, and the rights propagation is not working properly, then nothing will work very well and this plugin fails. Specially in a SAFE_MODE on situation (deprecated for PHP 6+ I believe, thus really should not exist any more on PHP 5.x setups).

y2ksw
07-27-2012, 06:11 AM
Donated PayPal to author and been using this terrific mod for a year or so now and it's great !!!

Running 4.1.3pl5 ...

We've come across something weird with it I can't figure out. A member referenced 5 JPG pics (all under 100k in size) using IMG bbcode and pointing to PhotoBucket.

y2ksw's excellent import mod executed it's scheduled task and imported 3 of them just fine ...

FR8002 imported as FR8002-1
FR8003 imported as FR8003-1
FR8004 imported as FR8004-1

It refused to import 2 of them titled:

FR-8001
FR-8005

With the first 3, a typical edit post showed links like this, as they are stored on our own server:

http://www.xxxx.com/images/imported/2012/07/FR8002-1.jpg
http://www.xxxx.com/images/imported/2012/07/FR8003-1.jpg
http://www.xxxx.com/images/imported/2012/07/FR8004-1.jpg

The same edited post shows links to where the two that didn't post as:

http://www.xxxx.com/ (Note: no reference to a pic at all)

There's nothing abnormal about the two pics that this mod fails to process, except they have a "-" dash character as the second character of the filename.

In order to get the pics to show for our member, I had to manually upload for the two of them from PhotoBucket into the imported directory and they display properly in vBulletin doing that. However, all testing I've done with test posts, consistently causes the import mod to fail on these two pics.

Anyone have any idea what's happening? :confused:

Is it possible that the "-" in the filename is causing a problem with this mod?

Thanks for any feedback ... :)

Regards,
Doug
The hyphen may cause problems with redirects on mod_rewrite, or maybe also with vbSEO which allows a final "-123" as a thread or forum indicator. Images should be excluded though.

Depending on the remote server, "-" may have all sorts of problems at their end, last not least an invalid image, which simply will never import because not conforming to the image standards. If it was for example a spoofed image (image is a script), it will not contain some tags in order to identify it self and thus will fail to load. It is a sort of inbuilt antivirus.

warlord0
07-27-2012, 09:28 AM
One of the things I did to help a bit of debugging was to query the database directly to see if things were happening as they should.

Here's a few pointers that might help. Tweak them as you see fit like is the iei_parsed set or not. Based on the queries in the actual code.

select * from iei_img;

SELECT t.threadid, postid, p.dateline FROM post p INNER JOIN thread t ON p.threadid = t.threadid WHERE iei_parsed=1 and pagetext LIKE '%[/IMG]%' order by postid limit 0,100;

warlord0
07-30-2012, 06:12 PM
Really, really liking this addon.

We have a forum that has been around 10 years. In that time people move on and some have now removed or edited photobucket and flickr accounts causing a few 404's for some images that were very useful.

This addon stops that from happening. Very pleased with it.

Rated accordingly.

warlord0
08-01-2012, 12:57 PM
Actually, just thought of something that would make this a killer app for us.

If as an admin there was a button on a post/thread that initiated an immediate backup or added it as a priority to the schedule.

That way when I find a thread that I really need to be sure I have copies of I just click and it gets copied.

y2ksw
08-01-2012, 01:49 PM
Actually, just thought of something that would make this a killer app for us.

If as an admin there was a button on a post/thread that initiated an immediate backup or added it as a priority to the schedule.

That way when I find a thread that I really need to be sure I have copies of I just click and it gets copied.
I added this suggestion to the devlog. However I'm unable to tell when I will put hands on.

SonSahne
08-04-2012, 07:19 PM
For version 3.8.x will be supported? image cache is old and useless.

warlord0
08-06-2012, 09:07 AM
I added this suggestion to the devlog. However I'm unable to tell when I will put hands on.

Many thanks.

No rush on it as I'm still doing a happy dance as it's backing stuff up for me :)

diyautoftw
08-11-2012, 03:12 PM
Hello,
I'd like the images in forum posts to be uploaded to the server when they are promoted to CMS articles. Is there any way to mod this to do that? I don't want all forum post images uploaded, just the images in the CMS articles. Thanks!

y2ksw
08-16-2012, 11:21 AM
Hello,
I'd like the images in forum posts to be uploaded to the server when they are promoted to CMS articles. Is there any way to mod this to do that? I don't want all forum post images uploaded, just the images in the CMS articles. Thanks!
The CMS is not handled yet and maybe never will. However, if you wait for the plugin to catch up, you promote discussions which already have their image imported.

alhidaya
08-16-2012, 10:59 PM
Hello,

Thanks for a great mod.

How do I add more tags into this mod ? Right now we can only use [img] tag. I do have :

and
and

on my forum to align images to the left or to the right of the post.

This is very IMPORTANT What should I do to install the images BB Code ?

y2ksw
08-18-2012, 08:34 AM
Hello,

Thanks for a great mod.

How do I add more tags into this mod ? Right now we can only use tag. I do have :

and
and

on my forum to align images to the left or to the right of the post.

This is very IMPORTANT What should I do to install the images BB Code ?

For these tags there is no automatic solution. You will have to trasform these tags manually with the MySQL REPLACE function (backup first!!!), for example:
UPDATE post SET pagetext=REPLACE(pagetext, '', '[IMG]')
UPDATE post SET pagetext=REPLACE(pagetext, '', '')
I reccomend not to use image modifications in vbulletin if you want to use this product.

To enable IMG you will have to change your vbulletin options at several places: show all options and search for IMG ;)

spencerp
08-20-2012, 07:36 AM
Theorically it can be changed in order to download the source images and the thumbnails. However, each system has different ways and changes them from time to time, in order to avoid direct downloading. Since this is freeware and I have no income with it, nor are there enough customers for asking this feature, it is unlikely it will be ever implemented.

Similarily, the file server/gallery issue has been discussed before. If there was a consistent number of users requesting to move files to another server, I may look into moving files via FTP and/or PHP's fopen and updating queries and so stuff. But until now you are only about the third person asking for this feature. Instead, you may use fsftp for Linux, which transparently links another server to a symbolic link of your forum root subfolder of your choice. There may be other solutions too. I do not support any of those solutions ;)

Basically, this is what I need though. The forums were started for when the members would go to some image hosting site like; imagevenue.com, imgbox.com, and so forth... Select and Copy the BBCode for thumbnails that link to full size images... and paste the codes into the forum threads/posts.

I'd love to be able to have this run, and automatically parse/convert all imagevenue.com and imgbox.com and etc BBCodes to default vbulletin ... or import them as attachments with thumbnails and full size images automatically. Is there anything for vbulletin (if not your plugin/modification maybe another one?) that can maybe do this? Thanks

y2ksw
08-20-2012, 10:03 AM
Basically, this is what I need though. The forums were started for when the members would go to some image hosting site like; imagevenue.com, imgbox.com, and so forth... Select and Copy the BBCode for thumbnails that link to full size images... and paste the codes into the forum threads/posts.

I'd love to be able to have this run, and automatically parse/convert all imagevenue.com and imgbox.com and etc BBCodes to default vbulletin ... or import them as attachments with thumbnails and full size images automatically. Is there anything for vbulletin (if not your plugin/modification maybe another one?) that can maybe do this? Thanks
The Linux File System FTP feature is called curlftpfs and I have briefly discussed it here (https://vborg.vbsupport.ru/showthread.php?p=2317367&highlight=curlftpfs#post2317367). For making it work perfectly well, you will have to ask a top-techy, which may be able to tweak your system in a way that imported images are going somewhere else.

There is no inbuilt feature and software solutions would be far over the top of this, maybe any product :)

spencerp
08-20-2012, 01:01 PM
The Linux File System FTP feature is called curlftpfs and I have briefly discussed it here (https://vborg.vbsupport.ru/showthread.php?p=2317367&highlight=curlftpfs#post2317367). For making it work perfectly well, you will have to ask a top-techy, which may be able to tweak your system in a way that imported images are going somewhere else.

There is no inbuilt feature and software solutions would be far over the top of this, maybe any product :)

ahhh okay... Hmm, maybe I'll get one of the support techs on live chat then. but stupid me, i ran that plugin and it started parsing/importing images from THIS MONTH.. cause i made it so they go into /attachments/2012/08/ ... and alot of images were going there... but when viewing threads.. it still showed or seemed to link to imagevenue.com anyway.. so i went and deleted the 2012/08 folders.. and now alot of the threads for this month aren't showing images at all. :( and plus it made the database HUGE... its like 78MB!!! :(

is there anyway to have this plugin import the images... but just have it to filesystem automatically? I didn't want to put all that load into database in first place. the disk space i need not worry about, its the database size that's issue. and now it's STILL 78MB.. >_<. and on top of it, alot of August's threads are image-less... :(

also... when viewing threads in advanced edit.. its like [U R L="http://img156.imagevenue.com/img.php?image=79993_12708391_122_34lo.jpg"][I M G]http://footish.xxx/attachments/2012/08/376.jpg[/I MG ][/U RL ]

of course the attachments/2012/08/blahblah.jpg arent showing anything.. but still have the imagevenue.com thumbnail preview links.. is there to remove the external thumbnail preview links when parsing from get go? or.. have those imported too, not just the full image?

y2ksw
08-20-2012, 02:43 PM
This plugin doesn't add size to your database. It imports external images to the local file system. But I understood you would like to keep the images elsewhere and for this reason there is the article about curlftpfs.

Only img tags are imported unless you add other tags (and you understand what the option does). There is no such thing as capturing wrapping images, too.

Krusty1231
08-25-2012, 11:21 AM
I am confused. I can run it just fine, but it gives me this when I try to enable the cron job.

This scheduled task cannot be enabled. vB4 Import External Images, the product associated with this task, is currently disabled. It must be enabled before this task can be enabled.

What am I doing wrong? I can see the images being created in the /imported folder just fine.

It just will not enable the cron job for me.

y2ksw
08-26-2012, 09:13 AM
Looks like the product is disabled ;)

Krusty1231
08-27-2012, 07:20 AM
LOL - so it is..... Doh!

Thanks for the hint! I feel retarded now! :)

y2ksw
08-27-2012, 11:34 AM
welcome back from holidays! :)

vvlo
09-01-2012, 08:58 PM
tnk u, but this mod for my forum not work : link (http://deltamarine.info/f228/%D8%B3%D9%88%D9%85%DB%8C%D9%86-%D8%A2%DA%A9%D9%88%D8%A7%D8%B1%DB%8C%D9%88%D9%85-%D8%AD%D8%B1%D9%81%D9%87-%D8%A7%DB%8C-%D8%AE%D8%A7%D8%B1%D8%AC%DB%8C-%D9%85%D8%B9%D9%86%D8%A7%DB%8C-%D8%B9%D8%B4%D9%82-%D9%88%D8%A7%D9%82%D8%B9%DB%8C-%D8%A2%D9%85%D9%88%D8%B2%D8%B4-%D9%88-%D8%A7%DB%8C%D8%AF%D9%87-921/)

y2ksw
09-03-2012, 01:51 PM
tnk u, but this mod for my forum not work : link (http://deltamarine.info/f228/%D8%B3%D9%88%D9%85%DB%8C%D9%86-%D8%A2%DA%A9%D9%88%D8%A7%D8%B1%DB%8C%D9%88%D9%85-%D8%AD%D8%B1%D9%81%D9%87-%D8%A7%DB%8C-%D8%AE%D8%A7%D8%B1%D8%AC%DB%8C-%D9%85%D8%B9%D9%86%D8%A7%DB%8C-%D8%B9%D8%B4%D9%82-%D9%88%D8%A7%D9%82%D8%B9%DB%8C-%D8%A2%D9%85%D9%88%D8%B2%D8%B4-%D9%88-%D8%A7%DB%8C%D8%AF%D9%87-921/)
Have you checked that fopen for URL's is enabled? Do you have CURL or sockets available? May your server pull in external sources?

If your server does not allow to connect to and read external resources, it will not be able to import any image.

jo8jo
09-20-2012, 07:02 AM
Excellent mod!

I have one question: do you think it is possible to create folders for days, too?

...it creates folders for years and months...

Thanks in advance :up:

y2ksw
09-20-2012, 03:06 PM
Excellent mod!

I have one question: do you think it is possible to create folders for days, too?



Thanks in advance :up:
I think this does not make much sense even for very large forums. Large forums will have a Linux Server, which has no problem at all to host tens of thousands of files in a single folder, and smaller forums with Windows servers will run into problems not before 30000 files each directory. That is about 1000 files daily, plenty to play with :)

Disco_Dave
09-26-2012, 10:03 AM
Hi

Just a quick question, I have a from member that uses photobucket. And for some reason she has an extra [img] before and after her images, will this stop your hack from working?

Dave

y2ksw
09-26-2012, 11:41 AM
Hi

Just a quick question, I have a from member that uses photobucket. And for some reason she has an extra [img] before and after her images, will this stop your hack from working?

Dave
It should not make any difference.

Manoel J?nior
09-26-2012, 02:03 PM
You have plans to update this mod for vBulletin5?

y2ksw
09-26-2012, 03:39 PM
You have plans to update this mod for vBulletin5?
probably ... but not before it is really stable ... another 2 years to go :)

Disco_Dave
10-01-2012, 12:07 PM
It should not make any difference.

I keep checking this one thread with the photobucket images, and they seem to be the only ones that have not went through your program (add-on) is there a way to force it to do so?

Dave

Krusty1231
10-03-2012, 12:05 AM
Is there something I could use with this mod to watermark my images? Does anyone else use something to watermark the images, and willing to share?

Thanks in advance!

Reinhard
10-05-2012, 07:24 PM
@y2ksw: Can you add the postid in the table iei_img? This makes it easier to find wrong urls in the post.

y2ksw
10-10-2012, 07:21 AM
@y2ksw: Can you add the postid in the table iei_img? This makes it easier to find wrong urls in the post.
Scheduled for next review :)

inigo
10-10-2012, 08:51 AM
One question, is it possible to retreive the images and upload to other server?

For exaple giving a FTP account, so the forum domain is:

www.forum.com

And all the images are stored in other server/domain, for example

www.forumimages.com

so you have them in your server n?2, and all the posts in FORUM (in server 1) links them as:

[IMG ]http://www.forumimages.com/image 1.jpg [/IMG ]

Thanks!

sticky
10-10-2012, 09:05 AM
Is there something I could use with this mod to watermark my images? Does anyone else use something to watermark the images, and willing to share?

Thanks in advance!
Same, this would be awesome...

y2ksw
10-11-2012, 11:13 AM
One question, is it possible to retreive the images and upload to other server?

For exaple giving a FTP account, so the forum domain is:

www.forum.com (http://www.forum.com)

And all the images are stored in other server/domain, for example

www.forumimages.com (http://www.forumimages.com)

so you have them in your server n?2, and all the posts in FORUM (in server 1) links them as:

[IMG ]http://www.forumimages.com/image 1.jpg [/IMG ]

Thanks!
Please see here (https://vborg.vbsupport.ru/showthread.php?p=2317367&highlight=curlftpfs#post2317367). :)

y2ksw
10-11-2012, 11:15 AM
Same, this would be awesome...
I am against watermarking images coming from other sites and thus will not implement this feature.

If you want to watermark the files, you may use quite easily a self-tailored script from SSH, or via cronjob and PHP, operating directly on the imported files.

sticky
10-12-2012, 09:21 PM
This mod works almost perfectly except when a image is something like IMG_1123-1.jpg?t=1349992120 .

If there is anything after the .jpg it rarely imports correctly.

sticky
10-12-2012, 09:21 PM
I am against watermarking images coming from other sites and thus will not implement this feature.

If you want to watermark the files, you may use quite easily a self-tailored script from SSH, or via cronjob and PHP, operating directly on the imported files.
Well it's more that people use you as a host and steal your bandwith so you should get credit for you bandwith/server use.

I honestly don't know how to do what you mentioned but would love to learn and implement it...

BadgerDog
10-13-2012, 09:59 AM
This mod works almost perfectly except when a image is something like IMG_1123-1.jpg?t=1349992120 .

If there is anything after the .jpg it rarely imports correctly.

I have exactly the same problem with filenamse containing a "-"....

Refer to my original post and y2ksw's anser following a few posts later:

Post 367 (click here) (https://vborg.vbsupport.ru/showpost.php?p=2351560&postcount=367)

From his answer, I assume there's nothing can be done about the issue... :(

Other than that, this is a fabulous mod and a great addition to our site... :up:

Regards,
Doug

y2ksw
10-15-2012, 03:37 PM
This mod works almost perfectly except when a image is something like IMG_1123-1.jpg?t=1349992120 .

If there is anything after the .jpg it rarely imports correctly.
You may convert images to jpg and then all images will not carry the original filename and/or extension.

However, if an image is dynamically linked, visibility may depend on your logged in state (or the state the "pasting" user is in) and thus may not work in any case. The server script is not logged into the remote media server (is a guest) and thus may not see anything.

ZEHH
10-16-2012, 05:37 PM
Muito bom !!

lazydesis
11-02-2012, 02:43 PM
this is working fine for me on vb3.8.7 .. just needed to remove the dependencies on the product file for it be installed

thanks

Bob_R
11-14-2012, 09:33 PM
I'm interested in this mod. Should I download 1.0.2, 1.0.4, or 1.0.5? :confused: I assume 1.0.2 but I wish to be sure before I proceed. :)

And, what happened to 1.0.3? :D

sticky
11-15-2012, 06:58 AM
You may convert images to jpg and then all images will not carry the original filename and/or extension.

However, if an image is dynamically linked, visibility may depend on your logged in state (or the state the "pasting" user is in) and thus may not work in any case. The server script is not logged into the remote media server (is a guest) and thus may not see anything.

That's not the issue. The issue is if someone is linking to a file that has anything after the .jpg. Then it doesn't import correctly.

y2ksw
11-15-2012, 02:04 PM
I'm interested in this mod. Should I download 1.0.2, 1.0.4, or 1.0.5? :confused: I assume 1.0.2 but I wish to be sure before I proceed. :)

And, what happened to 1.0.3? :D
normally you would choose the latest version. 1.0.5 :)

Bob_R
11-16-2012, 06:36 PM
normally you would choose the latest version. 1.0.5 :)

Gotcha ya!

It hasn't finished importing all the images yet. So, I hit Run Now in the Scheduled Task Manager and got this:

Request Timeout

This request takes too long to process, it is timed out by the server. If it should not be timed out, please contact administrator of this web site to increase 'Connection Timeout'.

Anything I can do about this?

It's scheduled to run every 10 minutes but the latest images imported were at 10:35 this morning :confused: about 4 hours ago.

EDIT

Another question

Include Forum ID's and Exclude Forum ID's

I did not enter any forumids in either box. Is this correct?

Thanks!!

y2ksw
11-17-2012, 11:47 AM
Gotcha ya!

It hasn't finished importing all the images yet. So, I hit Run Now in the Scheduled Task Manager and got this:

Request Timeout

This request takes too long to process, it is timed out by the server. If it should not be timed out, please contact administrator of this web site to increase 'Connection Timeout'.

Anything I can do about this?

It's scheduled to run every 10 minutes but the latest images imported were at 10:35 this morning :confused: about 4 hours ago.

EDIT

Another question

Include Forum ID's and Exclude Forum ID's

I did not enter any forumids in either box. Is this correct?

Thanks!!
1. There is nothing I can do about connection timeouts. It may be your PHP hosting plan has Safe Mode enabled and thus will timeout at the system settings. Or, the server is simply too busy to make fast connections on outgoing requests.
2. You should not play with these (actually all) options unless you really need to :)

Bob_R
11-17-2012, 02:29 PM
1. There is nothing I can do about connection timeouts. It may be your PHP hosting plan has Safe Mode enabled and thus will timeout at the system settings. Or, the server is simply too busy to make fast connections on outgoing requests.
2. You should not play with these (actually all) options unless you really need to :)

OK.

So what do I do?

It hasn't run in nearly 24 hours.

Thanks.

Bob_R
11-17-2012, 06:35 PM
These are instructions from the PDF file:

Large image quantities
If you have a very high number of images, the iei_cron.php task may run out of memory. If this happens, you can empty the iei_img table. By doing so, the script will start over with a new array of imported images, which is acceptable once and then. If you want to keep the history, please feel free to keep a backup of this table.

Please explain in detail how to do this.

This may be my problem. I've reduced the posts at once to 5. Convert to jpg and disabled Cache Image URL's.

y2ksw
11-18-2012, 12:10 PM
These are instructions from the PDF file:

Large image quantities
If you have a very high number of images, the iei_cron.php task may run out of memory. If this happens, you can empty the iei_img table. By doing so, the script will start over with a new array of imported images, which is acceptable once and then. If you want to keep the history, please feel free to keep a backup of this table.

Please explain in detail how to do this.

This may be my problem. I've reduced the posts at once to 5. Convert to jpg and disabled Cache Image URL's.
If you have this option (depends on release you are using):

Cache Image URL's
Cache image URL's into memory. If you have a large board, a lot of imported images and limited memory, you may want to switch this option off. If disabled, images are tested by less efficient database queries.

Try to switch it off, first (No). Then, each request for an image is queried from the database instead of loading the file list into memory. If this does still not work, then you have a different problem.

Rckcrwlr
11-20-2012, 12:38 PM
I'm in the process of a doing a new install with my existing DB. It got me thinking...if I uninstall this, what can I expect to happen?

Will it say with them locally?
Default back to original?
Lose all images?

Thanks
John

y2ksw
11-20-2012, 09:11 PM
I'm in the process of a doing a new install with my existing DB. It got me thinking...if I uninstall this, what can I expect to happen?

Will it say with them locally?
Default back to original?
Lose all images?

Thanks
John
A new install with the same database and all data? how? :)

At worst, the new installation of this product will try to re-import the images. However the uninstall code should be commented out and the lookup table should remain in place. Thus, reinstalling the plugin should not do any harm.

If the uninstallation code is not commented out, you will not loose any images though, because they are stored to your web space.

webrats
11-26-2012, 08:08 PM
can we store the images in the DB

y2ksw
11-27-2012, 06:03 PM
can we store the images in the DB
No. This plugin is intended to download images from external sites and store them to the file system. It is not meant to be a revamped or integrated attachment system :)

webrats
12-03-2012, 02:12 AM
No. This plugin is intended to download images from external sites and store them to the file system. It is not meant to be a revamped or integrated attachment system :)

to bad, it make it hard for people with multiple servers to use :(

can you associate a sub-domain with the images?

Manoel J?nior
12-03-2012, 09:00 PM
Is there any way to debug and verify because the product in my Forum stopped working. Is there any way to debug and verify?

y2ksw
12-04-2012, 08:27 AM
to bad, it make it hard for people with multiple servers to use :(

can you associate a sub-domain with the images?
You may redirect images via .htaccess, for example.

I don't see the problem however. If you have multiple servers, how do the images influence their manner of "seing" images? Could you make an example of what you ahve and what you would like to have?

y2ksw
12-04-2012, 08:28 AM
Is there any way to debug and verify because the product in my Forum stopped working. Is there any way to debug and verify?
One of the possible issues are missing space, but also server settings. If your server disallow pulling in external content (sockets, curl, fopen) it is likely not working.

webrats
12-04-2012, 09:10 AM
You may redirect images via .htaccess, for example.

I don't see the problem however. If you have multiple servers, how do the images influence their manner of "seing" images? Could you make an example of what you ahve and what you would like to have?

all my servers are behind a load balancer , they are all clones of each other.
you hit a random server every time you hit my site.
the easiest fix is to push the images to the db since. all the servers grab the images from the DB. since the db stores ALL the images its very easy to keep everything updated and accurate on all the servers.

y2ksw
12-04-2012, 02:13 PM
all my servers are behind a load balancer , they are all clones of each other.
you hit a random server every time you hit my site.
the easiest fix is to push the images to the db since. all the servers grab the images from the DB. since the db stores ALL the images its very easy to keep everything updated and accurate on all the servers.
If the servers are cloned, they should replicate/mirror the images after a while, too ... or not?

tourajabbasi
12-06-2012, 04:46 AM
Hi,

My server suddenly stopped importing pictures...
can you tell me which settings do i have to check ?
(sockets, curl, fopen) where are they in the server?

We are using dedicated server / centos 6 / 64bit

Thank you

y2ksw
12-06-2012, 07:14 AM
Hi,

My server suddenly stopped importing pictures...
can you tell me which settings do i have to check ?
(sockets, curl, fopen) where are they in the server?

We are using dedicated server / centos 6 / 64bit

Thank you
You first should check if your firewall allows to pull in external data, before anything else. Then, if PHP allows to use fopen on external sources, then which options are checked. If fopen does not allow to pull data, you must have CURL instead. The plugin prefers CURL over sockets and falls back to sockets, unless you choose to use only sockets.

Manoel J?nior
12-16-2012, 12:53 AM
One of the possible issues are missing space, but also server settings. If your server disallow pulling in external content (sockets, curl, fopen) it is likely not working.
Searching deeper, more exactly in error_log me this message appears:

[16-Dec-2012 00:33:19 UTC] PHP Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 2800 bytes) in /home/test/public_html/forum/includes/cron/iei_cron.php on line 92

Was that why the product is not working properly? What should I do?

y2ksw
12-18-2012, 03:36 PM
Searching deeper, more exactly in error_log me this message appears:

[16-Dec-2012 00:33:19 UTC] PHP Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 2800 bytes) in /home/test/public_html/forum/includes/cron/iei_cron.php on line 92Was that why the product is not working properly? What should I do?
I think the product tried to load a huge image. PHP usually has a space limit and in this case it has 128 MB per process and this memory ran out of space. Maybe you need to enable the image resizing and trim imported images down to a suitable limit.

Manoel J?nior
12-19-2012, 11:30 PM
Hi y2ksw,

That even when not doing more cache have to put the value 0 in attributes: Maximum Width and Maximum Height.

When I put 0 value stopped giving error and now is doing the caching of images.

Thanks for all the help and serves as a warning to others.

Doganay YILDIZ
12-22-2012, 01:16 PM
There is a problemmi? Pictures ftp uploading beautifully. However, I opened the new topics added almost 6 hours but still ftp. What's the problem?

cylon1
12-26-2012, 05:36 AM
Dear friends:

This extension is amazing, I use it since months, and all works very well. The only problem is that, I'm using a vps with limited resources (apache, 512Mb ram). I've noticed that one of the slowest sql in my vps is the following:

# Query_time: 16.976461 Lock_time: 0.000214 Rows_sent: 0 Rows_examined: 278721
SET timestamp=1356435021;
SELECT postid, dateline, pagetext
FROM post
WHERE iei_parsed=0
AND pagetext LIKE '%[/IMG]%'
ORDER BY postid
LIMIT 0, 5;

As you can see, my posts table has only 278721 rows. I think this is a small forum, I suppose that there will be bigger forums out there. But you can see too, that the query time is very high (16sg). I have discarded another problem (very much visits, and so on).

Is there a way to increase the perfomance of this query?

Best regards and thanks in advance.

y2ksw
12-28-2012, 09:17 AM
Dear friends:

This extension is amazing, I use it since months, and all works very well. The only problem is that, I'm using a vps with limited resources (apache, 512Mb ram). I've noticed that one of the slowest sql in my vps is the following:

# Query_time: 16.976461 Lock_time: 0.000214 Rows_sent: 0 Rows_examined: 278721
SET timestamp=1356435021;
SELECT postid, dateline, pagetext
FROM post
WHERE iei_parsed=0
AND pagetext LIKE '%[/IMG]%'
ORDER BY postid
LIMIT 0, 5;As you can see, my posts table has only 278721 rows. I think this is a small forum, I suppose that there will be bigger forums out there. But you can see too, that the query time is very high (16sg). I have discarded another problem (very much visits, and so on).

Is there a way to increase the perfomance of this query?

Best regards and thanks in advance.
Not that I can think of. A server should really ahve more than 512 MB of RAM, specially when using a database server, too. You may try to add some MB to the MySQL key buffer, but I doubt it will help.

y2ksw
12-28-2012, 09:20 AM
There is a problemmi? Pictures ftp uploading beautifully. However, I opened the new topics added almost 6 hours but still ftp. What's the problem?
I don't know. This product imports only external images which can be read by the server, using CURL or fopen. If it doesn't work for you, I'm sorry, but there is nothing I can do about.

destacamos
01-12-2013, 05:33 PM
I installed this prodcut, but does nothing.

forum is installed in a subfolder:

www.website.com/forum

i create a folder images/imported to:

www.website.com/forum/images/imported

with 777 permissions

I uploaded the xml file, and nothing, when I put a picture in the forum does nothing.

for example I try this:
http://www.miblogdecineytv.com/imagenes/peliculas/Cars3.jpg

created a thread and put the image Image

and still appears the url of miblogdecine .... and no create nothing in my server.

can anyone help me, please? thanks.

y2ksw
01-14-2013, 09:12 PM
If it does nothing (please check with FTP in your imported folder), you system does not allow to pull in external data.

datoneer
01-17-2013, 01:50 AM
Installed, rated and nominated this is great mod

y2ksw
01-17-2013, 01:02 PM
Installed, rated and nominated this is great mod
Thanks :)

hakkuo23
01-17-2013, 01:08 PM
Can you make this work for signatures, or at least some curl script to just display signature images so I can keep SSL on my site?

y2ksw
01-19-2013, 11:16 AM
Can you make this work for signatures, or at least some curl script to just display signature images so I can keep SSL on my site?
It works for images of any kind on any site which will allow hotlinking. It does not influence or depend on SSL, but it may not work for you, if the server isn't allowing to pull in external data.

dog-tag
01-30-2013, 05:07 PM
Hello y2ksw :)

I'm thinking about installing this and have a question.

Some of my users are using these pay per view image sites, and they're linking images on my forum. I would like to know if your plugin will -
Delete the link attached to these images?

You see they post the images, but when you click on the image they redirect you to some spammy website which really bugs me. Can your plugin remove this link also?

I understand I will host the image, but when I'm hosting the image, will I now be hardlinking my images to their websites?

Thanks for your time and workmanship!

Delfi_r
02-01-2013, 07:40 PM
It's possible that this product imports images on the blogs? It works beautifully on our site.

y2ksw
02-04-2013, 03:31 PM
Hello y2ksw :)

I'm thinking about installing this and have a question.

Some of my users are using these pay per view image sites, and they're linking images on my forum. I would like to know if your plugin will -
Delete the link attached to these images?

You see they post the images, but when you click on the image they redirect you to some spammy website which really bugs me. Can your plugin remove this link also?

I understand I will host the image, but when I'm hosting the image, will I now be hardlinking my images to their websites?

Thanks for your time and workmanship!
I'm sorry, this product is thought of hosting images only. But you could pretty easily replace the offending links with a query from phpMyAdmin, such as:

UPDATE post SET pagetext=REPLACE(pagetext, 'www.offending-host.tld', 'localhost')

The 'localhost' entry makes sure nobody ever will go anywhere but the own PC, but of course this may also not be desired (then, replace with a host of your choice). You will also have to truncate the postparsed table after such changes, and, as always, make a backup before testing :)

y2ksw
02-04-2013, 03:32 PM
It's possible that this product imports images on the blogs? It works beautifully on our site.
Nope, only forum posts are currently supported.

Kenas
02-07-2013, 05:13 PM
Hi, i think i got this mod working.
But in some cases the images are not being imported, i cant explain why.
Here few examples :

Working : http://www.gsmforum.es/showthread.php?24920-Bateria-Original-Nokia-BL-4C-860mAH-BLISTER (Img imported : http://www.gsmforum.es/images/imported/2013/02/1.jpg)

Not Working : http://www.gsmforum.es/showthread.php?24916-FullForce-todas-las-aplicaciones-de-iOS-a-pantalla-completa-en-el-iPhone-5 (Img not imported : http://img.applesfera.com/2013/02/fullforce-0.jpg)

How can i fix this ? i dont know why the is some working and others dont ;(

BadgerDog
02-07-2013, 05:27 PM
Hi, i think i got this mod working.
But in some cases the images are not being imported, i cant explain why.
Here few examples :(

https://vborg.vbsupport.ru/showpost.php?p=2372677&postcount=408

Regards,
Doug

Kenas
02-07-2013, 05:38 PM
https://vborg.vbsupport.ru/showpost.php?p=2372677&postcount=408

Regards,
Doug

Ok, but there is another forum that has this working. How ?
I mean they do import the image and store it and rename it.
I am not sure if it uses the same mod or any other, or tweaked something in it.

So you think there is any other solution or workaround ?

y2ksw
02-07-2013, 07:33 PM
If an external site refuses hotlinking, for example, it not will be possible to import the images in most cases.

Kenas
02-08-2013, 12:00 PM
If an external site refuses hotlinking, for example, it not will be possible to import the images in most cases.

Image does not refuse hotlinking, as i said its working on "others" site. I think is because of the hyphen as u said earlier...

delmarva
03-06-2013, 09:33 PM
After enabling the mod, I try to upload an attachment and get a blank grey screen. Any ideas?

delmarva
03-06-2013, 09:37 PM
The asset manager is an enhanced interface for uploading files. It allows users to reuse their existing attachments with ease. Some older browsers may have problems using the interface. Users may also choose to disable the asset manager from within their profiles.

I disabled this and it works now.

inigo
03-20-2013, 03:09 PM
Actually, just thought of something that would make this a killer app for us.

If as an admin there was a button on a post/thread that initiated an immediate backup or added it as a priority to the schedule.

That way when I find a thread that I really need to be sure I have copies of I just click and it gets copied.

Is this suggestion implemented? I think it is very interesting and useful,

Thanks,

y2ksw
03-20-2013, 05:10 PM
You may invert the search order and thus backup the newest threads first. However, this has some backdraws on large boards, such as much slower queries from MySQL.

inigo
03-20-2013, 06:36 PM
You may invert the search order and thus backup the newest threads first. However, this has some backdraws on large boards, such as much slower queries from MySQL.

I don't understand this, because the idea is only to import external images in one thread, not in the newest ones,... For example in the threadID=2345 (In all posts in that thread. ) or in one post postID=234567 (For example if you want to promote to article that post/thread,...).

Any ideas?

Thanks!!!!

y2ksw
03-20-2013, 06:50 PM
Nope ... this isn't going to be implemented any time soon ...

inigo
03-21-2013, 07:35 AM
:(

Ok, Thanks, I'll continue looking to get this functionality,

ikopylov
05-15-2013, 05:33 PM
I installed this mod works fine
Now came the question:
Is there any prospect of adding to Import images of the social groups

thank you

y2ksw
05-16-2013, 07:39 AM
I installed this mod works fine
Now came the question:
Is there any prospect of adding to Import images of the social groups

thank you
not yet ... but I take note :)

abieteh.com
06-05-2013, 07:22 PM
it dosent work for me / my version 4.2.1 / how can i use it for this v ? it isn't work , is it ? i guess

y2ksw
06-06-2013, 06:36 AM
it dosent work for me / my version 4.2.1 / how can i use it for this v ? it isn't work , is it ? i guess
I don't know. Maybe your hosting does not allow external URL's to get imported.

Disco_Dave
06-06-2013, 07:56 AM
I don't know. Maybe your hosting does not allow external URL's to get imported.


How can you tell if this is the case, because this mod worked prefect for us. But know it does nothing.

Dave

y2ksw
06-06-2013, 08:03 AM
How can you tell if this is the case, because this mod worked prefect for us. But know it does nothing.

Dave
oh well, i guessed :)

did you check the permissions? during upload maybe something has changed. if Apache can't access the import folders, nothing happens.

abieteh.com
06-06-2013, 12:56 PM
oh well, i guessed :)

did you check the permissions? during upload maybe something has changed. if Apache can't access the import folders, nothing happens.

can you tell me more about that ?

autoescala
06-06-2013, 01:14 PM
Works on 4.2.1 ? Regards

y2ksw
06-06-2013, 07:49 PM
can you tell me more about that ?
well simply said, the flders you are using for importing the images must have read/write permissions for the web server (chmod 755 or 777 depending on the server settings) and must be owned by the web process. If you haven't changed these settings during the upgrade process, it should work. However if it isn't you will have to ask somebody to look into it more closely.

y2ksw
06-06-2013, 07:50 PM
Works on 4.2.1 ? Regards
for me it works :)

abieteh.com
06-07-2013, 06:36 AM
well simply said, the flders you are using for importing the images must have read/write permissions for the web server (chmod 755 or 777 depending on the server settings) and must be owned by the web process. If you haven't changed these settings during the upgrade process, it should work. However if it isn't you will have to ask somebody to look into it more closely.

well , thank you so much , but i set it before but it still dosen't work ,

how about server ? can it cause by that ?

y2ksw
06-07-2013, 04:35 PM
well , thank you so much , but i set it before but it still dosen't work ,

how about server ? can it cause by that ?
if the server settings have changed, it can be caused by a missing CURL module and/or different fopen settings. Or even by a reduction of memory or script timeouts.

kether1
06-12-2013, 05:54 PM
Hi Giovanni,

I've installed this on a copy of a large forum with many posts (to test before going live). I would like to only run this on posts one year old or newer since I have been using your 3.x version of this software and have all of my other images cached. Is there a way to set the date where this starts to work? I don't need it or want it to modify posts from 2010 - 2002.

thanks so much!
Kether

y2ksw
06-13-2013, 08:31 AM
You may set (via phpmyadmin) the iei_parsed flag to 1, for all posts you would like to skip.

mertiliuss
06-13-2013, 12:30 PM
Is posible add watermark?

y2ksw
06-13-2013, 12:40 PM
Is posible add watermark?
No. But you could add your own at server side with image recoding I guess.

autoescala
06-14-2013, 09:14 AM
I use watermark, its easy just create .htcacces on the folder u save the pics and copy/paste:

RewriteEngine on
RewriteRule ^([^tn].*\.(gif|jpg|png))$ /imported_images/watermark.php?image=$1&watermark=watermark.png [NC]

But with this option I had a lot of complaints of my forum users, because they dont like watermark their images :D

I would like to know how to watermark with exceptions such image size, or file size,

Best Regards

y2ksw
06-14-2013, 10:08 AM
I use watermark, its easy just create .htcacces on the folder u save the pics and copy/paste:

RewriteEngine on
RewriteRule ^([^tn].*\.(gif|jpg|png))$ /imported_images/watermark.php?image=$1&watermark=watermark.png [NC]

But with this option I had a lot of complaints of my forum users, because they dont like watermark their images :D

I would like to know how to watermark with exceptions such image size, or file size,

Best Regards
This is actually a very nice solution I never thought about :up:

final kaoss
06-23-2013, 03:48 PM
Thanks, using it, does it work for avatars & sig images too?

y2ksw
06-24-2013, 09:32 AM
Thanks, using it, does it work for avatars & sig images too?
Nope, only posts.

fxdigi-cash
07-23-2013, 07:36 PM
look like there is some bug on vb.4.2.1. when the image imported locally from any post, a jpg file is saved where I indicated to save any image. However, the images have small sizes 1 Kb and when I preview them, they are all blank!!!

it was working very well on vb.4.2 pl3 , but now have this weird issue...

any idea how to get this resolved??

y2ksw
07-24-2013, 08:40 AM
look like there is some bug on vb.4.2.1. when the image imported locally from any post, a jpg file is saved where I indicated to save any image. However, the images have small sizes 1 Kb and when I preview them, they are all blank!!!

it was working very well on vb.4.2 pl3 , but now have this weird issue...

any idea how to get this resolved??
Please check the options. Most probably they got changed.

If this is not the problem, check the file permissions.

And, finally check that you actually can import images to your server. If you have moved to another place or the hosting provider has incidentally changed the server settings (yes, they do it always when you do some stuff, too ;)) it may happen you can't import images any more, and if the option says to replace invalid images, they are all small and "empty".

I have this plugin running on large forums and it is running flawlessly everywhere.

fxdigi-cash
07-24-2013, 02:52 PM
Please check the options. Most probably they got changed.

If this is not the problem, check the file permissions.

And, finally check that you actually can import images to your server. If you have moved to another place or the hosting provider has incidentally changed the server settings (yes, they do it always when you do some stuff, too ;)) it may happen you can't import images any more, and if the option says to replace invalid images, they are all small and "empty".

I have this plugin running on large forums and it is running flawlessly everywhere.

Thanks for the reply and feedback.

I'm using this version: 1.0.5.iei4

I will check the following and see what's going on:

1- mod options.
2- file permissions.
3- and whether I can import images to my server or not.

also I will check with my web host to see if there is any issue regarding importing images to the server or not.

Thanks, And be back to you with the feedback soon.

:)

Update:
1- mod options."checked"
2- file permissions."checked"
3- and whether I can import images to my server or not. "checked"

everything seems to be fine now. images can be imported, but still some images show 1kb size which means not imported. possibly the rss feed I get images from doesn't allow image import.

I guess I'm fine with this if there is not other way around this. Thanks a lot

behcet
08-05-2013, 10:16 AM
pc copy/paste import pls :D

y2ksw
08-05-2013, 12:02 PM
pc copy/paste import pls :D

This is impossible unless your PC is mapped world-visible. For this feature you'll probably need a pretty complex javascript.

m@hamad
08-08-2013, 03:18 PM
This hack is great! Thanks

This hack works on my friend site But it does not work for me .

Both sites are on a server .

tommythejoat
08-11-2013, 03:44 AM
I am using this and it is working great, but I would like the imported images to be available to use like my attachment library. I can search the post table for "pagetext like replacement url," but that is very database intensive. It would be nice if you stored the postid along with the other data in iei_img.

If you do not want to be bothered with that, I might take a shot at doing it myself. I understand this is not as simple as it sounds because of the synchronization issues with the batch job out gathering via curl.

Bob_R
08-20-2013, 12:14 AM
Can I change Always Convert Images from Yes to No after installation (installed over a year ago).

The animated gifs are saved to jpg and animation is lost.

Bob_R
08-20-2013, 12:23 AM
Mine keeps gifs as gifs... always has.

How so?

I used to love this mod. Now, with what I've discovered (post above this one) I'm not so sure.

Waiting on word if I can change settings.

y2ksw
08-20-2013, 08:36 AM
Can I change Always Convert Images from Yes to No after installation (installed over a year ago).

The animated gifs are saved to jpg and animation is lost.
Yes, any time.

However, converting images has several benefits, one of which is the removal of eventual malware. Since some file formats allow to hide scripts and thus run arbitrary code on the client browsers before viewing an image, the file conversion makes sure that such scripts are never executed, because such images are entirely removed.

Leaving the file format intact, you eventually do copy also malicious code, depending on how those images are crafted.

If you operate on a large site with a lot of users, you run better off with converting all images, because this way your site never falls into the category where it gets banned by spiders, namingly Google.

gsmlover4u
08-27-2013, 11:59 AM
i installed when i run it show me this database error

Database error in vBulletin 4.2.1:

Invalid SQL:
INSERT IGNORE INTO vb_iei_img (
oldurl,
newurl
) VALUES (
'http://img257.imageshack.us/img257/9922/3209vx4.jpg',
'http://www.******.com/clear.gif'
);

MySQL Error : MySQL server has gone away
Error Number : 2006
Request Date : Tuesday, August 27th 2013 @ 07:42:40 AM
Error Date : Tuesday, August 27th 2013 @ 07:43:40 AM
Script : http://www.*****.com/admincp/cronadmin.php?do=runcron&cronid=122
Referrer : http://www.****.com/admincp/cronadmin.php?do=modify
IP Address : ******.****
Username : jim
Classname : vB_Database
MySQL Version :

y2ksw
08-28-2013, 09:10 AM
Translated it says, the database server did not make it in time to reply to the web request. You probably have a hosting situation in which the database timeout is too low compared to the timeout of the web server.

gsmlover4u
08-29-2013, 04:38 AM
Translated it says, the database server did not make it in time to reply to the web request. You probably have a hosting situation in which the database timeout is too low compared to the timeout of the web server.

sir i am on shared server it mean this hack not working on shared server ?

y2ksw
08-30-2013, 06:40 AM
It works perfectly well in shared hosting, but may not work on time critical or overloaded hosting.

gsmlover4u
08-30-2013, 08:41 AM
sir it import images in images folder but after import 8 folder its giving this database error
but before it was working fine
is there problem in link ? cause image is removed from link

gsmlover4u
08-31-2013, 03:25 PM
when i remove this link http://img257.imageshack.us/img257/9922/3209vx4.jpg from post hack is working fine
but why not hack convert link to clear.gif ?

imageshake server giving error see screen short

gsmlover4u
08-31-2013, 07:15 PM
now database error on this link and image is removed from this link
http://img523.imageshack.us/img523/889/3310charge05122006efrcoea5.jpg
and hack is not working when image removed from link

y2ksw
09-01-2013, 05:08 AM
sir it import images in images folder but after import 8 folder its giving this database error
but before it was working fine
is there problem in link ? cause image is removed from link

If the server dies while importing images, it should have imported already the image and saving the new Url should be really the last step. The only sotuation where I may immagine problem with this, is where a database server dies while saving the data, and this happens typically with overloaded shared hosting.

If it was working fine before, please check with your hosting the changes which were made in the mean time to the system, nothing happens for no reason, never.

And, if an image is removed in the instance where an image is downloaded and saved to your server, it may become incomplete. GIF images would show then cut in half, I don't know about others.

And, in any case all of these problems have nothing to do with this plugin. these are server issues, some of which need good systemists to fix (db issues).

y2ksw
09-01-2013, 05:09 AM
when i remove this link http://img257.imageshack.us/img257/9922/3209vx4.jpg from post hack is working fine
but why not hack convert link to clear.gif ?

imageshake server giving error see screen short

There is nothing I can do about timeouts.

gsmlover4u
09-01-2013, 04:29 PM
If the server dies while importing images, it should have imported already the image and saving the new Url should be really the last step. The only sotuation where I may immagine problem with this, is where a database server dies while saving the data, and this happens typically with overloaded shared hosting.

If it was working fine before, please check with your hosting the changes which were made in the mean time to the system, nothing happens for no reason, never.

And, if an image is removed in the instance where an image is downloaded and saved to your server, it may become incomplete. GIF images would show then cut in half, I don't know about others.

And, in any case all of these problems have nothing to do with this plugin. these are server issues, some of which need good systemists to fix (db issues).

sir my server tech reply to of your this post
i am on urljet
Hi this is a 16core server and the load averages show
Load Averages: 5.56 4.86 4.54

The server is definitely not overloaded.
There have been no changes to our server configuration

where the developer says
"If the server dies while importing images, it should have imported already the image and saving the new Url should be really the last step."
The problem seems to me that since the link is not functional the image is never imported and its imposable to save any url.