vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vBulletin 4.x Add-ons (https://vborg.vbsupport.ru/forumdisplay.php?f=245)
-   -   Administrative and Maintenance Tools - Import External Images (https://vborg.vbsupport.ru/showthread.php?t=253309)

andy626 07-03-2017 07:33 AM

Quote:

Originally Posted by Kane@airrifle (Post 2588078)
Bad news, in testing I have found that the image is replace with the PB shakedown thumbnail

Oh crap, disaster!

But a million thank you's for testing this for me!

I think I still need this mod for Tapatalk and Forum Runner, etc.

Does it completely ruin the thread if I was to somehow find a script to find and replace photobucket.com/member/image123.jpg to myforum.com/member/image123 etc.

i.e: is the localised image link still the correct name/folder format of the original image or is the new image name the 3rd party thumbnail image link..... <--- Not even sure that will make sense to you :confused:

Appreciate your help though!

andy626 07-03-2017 07:52 AM

This is a bit of a disaster for me and I'm sure hundreds of forums out there surely?

What would be good if you can somehow get members to download their albums and photos off PB.

Then you upload it your server and somehow (???) run an attachment URL find and replace PB.com/member/ to yourforum.com/member/

Once that's been done, you don't need PB and then run this script here for the rest of the 3rd party hosting.

I never knew how vulnerable we are as forum owners when companies can suddenly change their ways and charge $399 per year to show your photos on 3rd party, crazy!

Kane@airrifle 07-03-2017 09:41 AM

This product will only download and replace images in the post table that are between the [img] [ /img] tags so I don't t think it can help you with member profile pics and member albums.

The localised path will be designated by you on setup, you have a choice whether or not to keep the original filenames or to have the mod change them to a numeric value name.

It is a disaster and I am sure there are millions of websites affected. I am pretty glad I installed this mod shortly after Imageshack pulled the same stunt that Photobucket is doing now.

andy626 07-04-2017 05:43 AM

Thanks again kane, I'm running this mod now excluding PB and its working great!

Can't believe I didn't have this on my forum earlier!!!

I'm asking for any help to somehow run an attachment find and replace URL script in this thread below if anyone can help I would be extremely grateful...

https://vborg.vbsupport.ru/showthread.php?p=2588046

The_Hawk 07-12-2017 11:03 PM

I'm in the same boat as everyone else since the photobucket issues. Sadly this mod has been on my todo list for almost a year and I never quite got there :(

It's now installed and running nicely (excluding photobucket at the moment), although with a shade under 1.1 million posts to trawl through it's going to take a while. I'm on a dedicated box so have pushed it up to 1000 posts per run and it seems to be coping (although I had to disable URL caching as it ran out of memory very quickly).

On the photobucket side there are a range of plugin for Chrome which claim to get around the issue, some are marked as dead already but at lease one is working for me.

While I'm sure that Photobucket will be killing these sorts of work around off as quickly as they can, I do wonder if this sort of approach could be built into this mod, even if it's only short lived, giving us all a chance to pull as many images as we can, while we can.

I have no idea what this would take, but I'd happily put in some $$ for the time it takes to get this up and running.

https://chrome.google.com/webstore/d...alioapbifiaedg

The_Hawk 07-13-2017 02:50 AM

Actually I spoke too soon, the cron job seems to have stopped running for no apparent reason. Even trying to tell it to "run now" seems to not work.

I did hit the "Allowed memory size exhausted" error, but turned off caching... then cleared the iei_img table as well. Still no luck.

I've set the number of posts back down to 10, re-imported the mod, checked the permissions on the folders, rebooted the server... still no clue.

Other tasks still appear to be running automatically or using the "run now" button (which then shows "done"), just not this one.

I can't seem to find any error message anywhere that would point to why this is failing. Any suggestions are welcome.

The_Hawk 07-15-2017 01:44 AM

So I've had a few messages back and forth with y2ksw, which has been brilliant.

The latest advice was the PHP might be silently crashing and wanted more memory. I've been slowly upping the max_memory (as I didn't want to go unlimited just yet) and it's running again. I'm somewhere north of 40,000 images checked so far (excluding photobucket) and I'm currently running at only about 40% of links being found. To be fair this is
2005 - 2011 so it's less of a surprise but really does ram home the need to run a script like this one if possible.


Quote:

We had this issue in the past with very large images (like 10.000x20.000 pixel) and PHP silently crashing upon insufficient memory. If you are on a dedicated box, you may try to assign "-1" (=any) to max memory. Else, you may try to sign the first unscanned post as scanned to skip over the post which creates this problem.

Kane@airrifle 07-16-2017 11:16 AM

A work around for the PB issue. edit /includes/cron/iei_cron; after line 268 add:

Code:

if (is_numeric(stripos($url, 'photobucket')))
    {
        curl_setopt($ch, CURLOPT_REFERER, 'http://www.photobucket.com/');
    }

I have tested it on a few known blocked PB images and it imports them just fine.

*not my code, was posted elsewhere by "IA1"

fwulfers 07-19-2017 07:11 PM

Thanks so much for this plugin and the code update for Photobucket. I installed in on our forum (vB 4.2.5), made the change to the code and it downloads the PB images just fine. Many tutorials and other important threads will now be useful again.

y2ksw 07-20-2017 07:23 AM

... and most of all, you never lose them again :)


All times are GMT. The time now is 05:36 AM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01816 seconds
  • Memory Usage 1,747KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)bbcode_code_printable
  • (2)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (4)pagenav_pagelink
  • (2)pagenav_pagelinkrel
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (10)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete