Thread: Administrative and Maintenance Tools - Import External Images
View Single Post
  #515  
Old 09-09-2013, 02:39 PM
y2ksw's Avatar
y2ksw y2ksw is offline
 
Join Date: Aug 2003
Location: Italy
Posts: 1,418
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by tommythejoat View Post
My moderators are reporting problems with this feature. It appears that images are being replaced with the wrong, seemingly random image.

I spent some time looking at the iei_img table and the post table with the following results.

We have 798,156 posts.
23,105 of the posts contain at least one IMG bbcode.
25,859 are marked iei_parsed.

In the iei_img table we have 34,257 records.
Of these 20,420 saved images are mapping unique external images.
We have 11,015 records with our web root (forum) directory as the saved entry (no jpg)
The big problem is 911 of the save images map multiple external images with as many as 204 references down to 2 references.

Other than restoring my backups from before I installed iei, I do not know how to recover the erroneous image mappings.

I do not really understand how the batches are managed while importing images. It appears that it is not working correctly.

We are running 4.2.1 with iei 1.0.5
If the "missing/invalid" image replacement is disabled, the original links are maintained, when this product is unable to import an image. For this reason it is most probable that random images are still within the img tags, since those are unlikely to work, ever. For example, some sites don't allow hot linking, and thus put junk redirects on line. Then this product wants to import them and sees, it can't. If missing images are replaced, it will typically use clear.gif or something alike to replace the missing image. Else, it will leave the link intact, and it may work for a while, until this kind of images disappear from source.

There is nothing I can do about it, this is how Internet works.

You may reparse all or part of the posts setting the iei_parsed flag to 0. Some sites do allow hot linking after a while and so you may get them later. I've been using this product over many years now on large production sites and we have had a number of problems, which were all related to remote images. Some of which were WORM infected, some where hotlink protected and others just would not conform to the standards. But these are few exceptions out of thousands of imported images every month.
Reply With Quote
 
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01208 seconds
  • Memory Usage 1,768KB
  • Queries Executed 11 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD_SHOWPOST
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)bbcode_quote
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)post_thanks_box
  • (1)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (1)post_thanks_postbit_info
  • (1)postbit
  • (1)postbit_onlinestatus
  • (1)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • reputationlevel
  • showthread
Included Files:
  • ./showpost.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_postinfo_query
  • fetch_postinfo
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showpost_start
  • bbcode_fetch_tags
  • bbcode_create
  • postbit_factory
  • showpost_post
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • fetch_musername
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • showpost_complete