Go Back   vb.org Archive > vBulletin Modifications > vBulletin 4.x Modifications > vBulletin 4.x Add-ons
FAQ Community Calendar Today's Posts Search

Reply
 
Thread Tools
Import External Images Details »»
Import External Images
Version: 1.0.5, by y2ksw y2ksw is offline
Developer Last Online: Feb 2023 Show Printable Version Email this Page

Category: Administrative and Maintenance Tools - Version: 4.x.x Rating:
Released: 11-06-2010 Last Update: 02-13-2011 Installs: 300
DB Changes Uses Plugins
Additional Files Translations  
No support by the author.

This vBulletin 4 product imports external images in your posts from external servers or paths into a specific path, normally your forum's image folder.

Differently than the previous product Image Cache for vBulletin 3.x., it parses the posts at regular intervals for new images and replaces the external references in the background. Also, instead of using only a single folder, it creates folders for years and months, making it much easier to handle large quantities of images. The source and destination image URL's are stored into database, too, avoiding unnecessary duplicates.

It moves and optionally converts images from one place to another. It is a handy tool in order to keep your images local to your forums.

Version 1.0.4 is temporarily in BETA stage until the users have confirmed the newly requested features.
Version 1.0.5 is still in BETA stage. It adds a new bunch of additional features, one of which allows you to test your mathematical understanding ... and a few other to fine-tune CURL and socket timeouts, and resizing on the fly of too large images. If you don't know what these options do, please leave them at their default values.

Download Now

File Type: zip 1.0.2.iei4.zip (80.0 KB, 477 views)
File Type: zip 1.0.4.iei4.zip (84.5 KB, 185 views)
File Type: zip 1.0.5.iei4.zip (87.5 KB, 2158 views)

Screenshots

File Type: jpg 08-11-2010-11.32.53.jpg (112.4 KB, 0 views)
File Type: jpg 02-02-2011-22.06.39.jpg (126.0 KB, 0 views)

Supporters / CoAuthors

Show Your Support

  • This modification may not be copied, reproduced or published elsewhere without author's permission.

Comments
  #762  
Old 07-03-2017, 07:33 AM
andy626 andy626 is offline
 
Join Date: Aug 2010
Posts: 40
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by Kane@airrifle View Post
Bad news, in testing I have found that the image is replace with the PB shakedown thumbnail
Oh crap, disaster!

But a million thank you's for testing this for me!

I think I still need this mod for Tapatalk and Forum Runner, etc.

Does it completely ruin the thread if I was to somehow find a script to find and replace photobucket.com/member/image123.jpg to myforum.com/member/image123 etc.

i.e: is the localised image link still the correct name/folder format of the original image or is the new image name the 3rd party thumbnail image link..... <--- Not even sure that will make sense to you

Appreciate your help though!
Reply With Quote
  #763  
Old 07-03-2017, 07:52 AM
andy626 andy626 is offline
 
Join Date: Aug 2010
Posts: 40
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

This is a bit of a disaster for me and I'm sure hundreds of forums out there surely?

What would be good if you can somehow get members to download their albums and photos off PB.

Then you upload it your server and somehow (???) run an attachment URL find and replace PB.com/member/ to yourforum.com/member/

Once that's been done, you don't need PB and then run this script here for the rest of the 3rd party hosting.

I never knew how vulnerable we are as forum owners when companies can suddenly change their ways and charge $399 per year to show your photos on 3rd party, crazy!
Reply With Quote
  #764  
Old 07-03-2017, 09:41 AM
Kane@airrifle's Avatar
Kane@airrifle Kane@airrifle is offline
 
Join Date: Jun 2011
Location: ZA
Posts: 181
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

This product will only download and replace images in the post table that are between the [img] [ /img] tags so I don't t think it can help you with member profile pics and member albums.

The localised path will be designated by you on setup, you have a choice whether or not to keep the original filenames or to have the mod change them to a numeric value name.

It is a disaster and I am sure there are millions of websites affected. I am pretty glad I installed this mod shortly after Imageshack pulled the same stunt that Photobucket is doing now.
Reply With Quote
Благодарность от:
andy626
  #765  
Old 07-04-2017, 05:43 AM
andy626 andy626 is offline
 
Join Date: Aug 2010
Posts: 40
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Thanks again kane, I'm running this mod now excluding PB and its working great!

Can't believe I didn't have this on my forum earlier!!!

I'm asking for any help to somehow run an attachment find and replace URL script in this thread below if anyone can help I would be extremely grateful...

https://vborg.vbsupport.ru/showthread.php?p=2588046
Reply With Quote
  #766  
Old 07-12-2017, 11:03 PM
The_Hawk The_Hawk is offline
 
Join Date: Aug 2009
Posts: 58
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

I'm in the same boat as everyone else since the photobucket issues. Sadly this mod has been on my todo list for almost a year and I never quite got there

It's now installed and running nicely (excluding photobucket at the moment), although with a shade under 1.1 million posts to trawl through it's going to take a while. I'm on a dedicated box so have pushed it up to 1000 posts per run and it seems to be coping (although I had to disable URL caching as it ran out of memory very quickly).

On the photobucket side there are a range of plugin for Chrome which claim to get around the issue, some are marked as dead already but at lease one is working for me.

While I'm sure that Photobucket will be killing these sorts of work around off as quickly as they can, I do wonder if this sort of approach could be built into this mod, even if it's only short lived, giving us all a chance to pull as many images as we can, while we can.

I have no idea what this would take, but I'd happily put in some $$ for the time it takes to get this up and running.

https://chrome.google.com/webstore/d...alioapbifiaedg
Reply With Quote
  #767  
Old 07-13-2017, 02:50 AM
The_Hawk The_Hawk is offline
 
Join Date: Aug 2009
Posts: 58
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Actually I spoke too soon, the cron job seems to have stopped running for no apparent reason. Even trying to tell it to "run now" seems to not work.

I did hit the "Allowed memory size exhausted" error, but turned off caching... then cleared the iei_img table as well. Still no luck.

I've set the number of posts back down to 10, re-imported the mod, checked the permissions on the folders, rebooted the server... still no clue.

Other tasks still appear to be running automatically or using the "run now" button (which then shows "done"), just not this one.

I can't seem to find any error message anywhere that would point to why this is failing. Any suggestions are welcome.
Reply With Quote
  #768  
Old 07-15-2017, 01:44 AM
The_Hawk The_Hawk is offline
 
Join Date: Aug 2009
Posts: 58
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

So I've had a few messages back and forth with y2ksw, which has been brilliant.

The latest advice was the PHP might be silently crashing and wanted more memory. I've been slowly upping the max_memory (as I didn't want to go unlimited just yet) and it's running again. I'm somewhere north of 40,000 images checked so far (excluding photobucket) and I'm currently running at only about 40% of links being found. To be fair this is
2005 - 2011 so it's less of a surprise but really does ram home the need to run a script like this one if possible.


Quote:
We had this issue in the past with very large images (like 10.000x20.000 pixel) and PHP silently crashing upon insufficient memory. If you are on a dedicated box, you may try to assign "-1" (=any) to max memory. Else, you may try to sign the first unscanned post as scanned to skip over the post which creates this problem.
Reply With Quote
Благодарность от:
y2ksw
  #769  
Old 07-16-2017, 11:16 AM
Kane@airrifle's Avatar
Kane@airrifle Kane@airrifle is offline
 
Join Date: Jun 2011
Location: ZA
Posts: 181
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

A work around for the PB issue. edit /includes/cron/iei_cron; after line 268 add:

Code:
if (is_numeric(stripos($url, 'photobucket')))
    {
        curl_setopt($ch, CURLOPT_REFERER, 'http://www.photobucket.com/');
    }
I have tested it on a few known blocked PB images and it imports them just fine.

*not my code, was posted elsewhere by "IA1"
Reply With Quote
7 благодарности(ей) от:
fwulfers, KevinL, Leebo89122, MarkFL, rkrenicki, The_Hawk, y2ksw
  #770  
Old 07-19-2017, 07:11 PM
fwulfers fwulfers is offline
 
Join Date: Aug 2010
Location: NW Michigan (USA)
Posts: 137
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Thanks so much for this plugin and the code update for Photobucket. I installed in on our forum (vB 4.2.5), made the change to the code and it downloads the PB images just fine. Many tutorials and other important threads will now be useful again.
Reply With Quote
Благодарность от:
Kane@airrifle
  #771  
Old 07-20-2017, 07:23 AM
y2ksw's Avatar
y2ksw y2ksw is offline
 
Join Date: Aug 2003
Location: Italy
Posts: 1,418
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

... and most of all, you never lose them again
Reply With Quote
Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 07:09 PM.


Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2024, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.10893 seconds
  • Memory Usage 2,380KB
  • Queries Executed 29 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)ad_showthread_beforeqr
  • (1)bbcode_code
  • (2)bbcode_quote
  • (1)footer
  • (1)forumjump
  • (1)forumrules
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (1)modsystem_post
  • (1)navbar
  • (4)navbar_link
  • (120)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (4)pagenav_pagelink
  • (2)pagenav_pagelinkrel
  • (11)post_thanks_box
  • (30)post_thanks_box_bit
  • (11)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (5)post_thanks_postbit
  • (11)post_thanks_postbit_info
  • (10)postbit
  • (5)postbit_attachment
  • (11)postbit_onlinestatus
  • (11)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open
  • (1)tagbit_wrapper 

Phrase Groups Available:
  • global
  • inlinemod
  • postbit
  • posting
  • reputationlevel
  • showthread
Included Files:
  • ./showthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_postinfo_query
  • fetch_postinfo
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showthread_start
  • showthread_getinfo
  • forumjump
  • showthread_post_start
  • showthread_query_postids
  • showthread_query
  • bbcode_fetch_tags
  • bbcode_create
  • showthread_postbit_create
  • postbit_factory
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • fetch_musername
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • post_thanks_function_fetch_thanks_bit_start
  • post_thanks_function_show_thanks_date_start
  • post_thanks_function_show_thanks_date_end
  • post_thanks_function_fetch_thanks_bit_end
  • post_thanks_function_fetch_post_thanks_template_start
  • post_thanks_function_fetch_post_thanks_template_end
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_attachment
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • pagenav_page
  • pagenav_complete
  • tag_fetchbit_complete
  • forumrules
  • navbits
  • navbits_complete
  • showthread_complete