Go Back   vb.org Archive > vBulletin 3 Discussion > vB3 General Discussions
FAQ Community Calendar Today's Posts Search

Reply
 
Thread Tools Display Modes
  #1  
Old 10-16-2007, 02:06 PM
lasto lasto is offline
 
Join Date: Jan 2002
Posts: 1,514
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default Moving attachments

As anyone on here had any experience with moving 30 gig worth if attachments which are stored in the file system.Reason im asking is because ive tried many times to impex them to another board with no success.

I have upped the memory limit in php ini because i was getting errors on moving them - and i have also tried just importing them straight into a fresh database using impex but everything i have tried just does not want to work.

I have a board that was orginally 3.5.4 but i updated it to 3.6.8 and some bugs have appeared on the board.So what im doing is making a fresh board with 3.6.8 and i have managed to impex all threads/posts/avatars/polls etc fine with no problems.
Only problem is with attachments - have tried numerous ways

1 - import into fresh database of new board - its a no go as i get multiple errors after a while even after upping phpini limit

66.67% Attachment -> powers series.jpg
Fatal error: Allowed memory size of 33554432 bytes exhausted (tried to allocate 2538179 bytes) in /admincp/impex/ImpExFunction.php on line 180

does about 400 meg then stops on the errors so have tried making it move them to a folder which has been chmodd but things get even worse from here,because when i input the source of the attachments all i get then is a blank screen and nowhere to go.

I have had impex inside the admincp folder and in the root,so i can try different ways but all mess up when doing attachments.

Has anyone got a better solution on how to go about this as the attachments are already stored in the filesystem on the server so need to get them attached to posts but impex wont let me.
I have posted over on vb.com to no avail

Dedicated server

PHP 5.2.4 PHP
Max Post Size 8.00 MB
PHP Maximum Upload Size 2.00 MB
PHP Memory Limit 24.00 MB
MySQL Version 4.1.22-standard
MySQL Packet Size 8.00 MB

a lot of the attachments which are stored average about 8 meg in size.
Reply With Quote
  #2  
Old 10-16-2007, 02:27 PM
Lynne's Avatar
Lynne Lynne is offline
 
Join Date: Sep 2004
Location: California/Idaho
Posts: 41,180
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

So you have about 30 GB worth of attachments all stored in the filesystem (so in a single folder) and you want to move those attachments/that folder over to another server and you are having problems?

I only have 6 GB of attachments, but I use scp to move a backup of the attachment folder between my two servers and it goes fine. I also use rsync to copy the contents of the folder onto my other server everyday and that works fine also. Have you tried either of those methods to transfer the files?
Reply With Quote
  #3  
Old 10-16-2007, 02:32 PM
lasto lasto is offline
 
Join Date: Jan 2002
Posts: 1,514
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

the attachments lynne are on the same server.
I have my main board which uses the folder with the attachments but i also have my test board which i have impexed everything to except the attachments.Im trying to kill off the main board once i got everything i need from it but attachments are not coming though with impex so they not added to posts/threads etc

Everything is on same server - im not tryin to move them elswhere.
Reply With Quote
  #4  
Old 10-17-2007, 06:05 AM
Marco van Herwaarden Marco van Herwaarden is offline
 
Join Date: Jul 2004
Posts: 25,415
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Fatal error: Allowed memory size of 33554432 bytes exhausted (tried to allocate 2538179 bytes) in /admincp/impex/ImpExFunction.php on line 180

Seems you had your memory_limit set to 32Mb. I suggest you try with 64Mb at least when on PHP5.

PS You might also need to up the MySQL memory limit and the PHP max_post_size.
Reply With Quote
  #5  
Old 10-17-2007, 01:57 PM
lasto lasto is offline
 
Join Date: Jan 2002
Posts: 1,514
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

cheers for reply marco i have upped them all and am doing 2 attachments at a time

when i say slow i mean slow and it will proberly take all week to do 30 gigs worth.

Server Type Linux
Web Server Apache v1.3.39
PHP 5.2.4
PHP Max Post Size 50.00 MB
PHP Maximum Upload Size 50.00 MB
PHP Memory Limit 64.00 MB
MySQL Version 4.1.22-standard
MySQL Packet Size 8.00 MB
Reply With Quote
Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 05:59 PM.


Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.03292 seconds
  • Memory Usage 2,195KB
  • Queries Executed 13 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)ad_showthread_beforeqr
  • (1)ad_showthread_firstpost
  • (1)ad_showthread_firstpost_sig
  • (1)ad_showthread_firstpost_start
  • (1)footer
  • (1)forumjump
  • (1)forumrules
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (1)navbar
  • (3)navbar_link
  • (120)option
  • (5)post_thanks_box
  • (5)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (5)post_thanks_postbit_info
  • (5)postbit
  • (5)postbit_onlinestatus
  • (5)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open
  • (1)tagbit_wrapper 

Phrase Groups Available:
  • global
  • inlinemod
  • postbit
  • posting
  • reputationlevel
  • showthread
Included Files:
  • ./showthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showthread_start
  • showthread_getinfo
  • forumjump
  • showthread_post_start
  • showthread_query_postids
  • showthread_query
  • bbcode_fetch_tags
  • bbcode_create
  • showthread_postbit_create
  • postbit_factory
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • fetch_musername
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • tag_fetchbit_complete
  • forumrules
  • navbits
  • navbits_complete
  • showthread_complete