View Single Post
  #919  
Old 07-11-2005, 04:00 AM
lierduh lierduh is offline
 
Join Date: Jan 2003
Location: Sydney, Australia
Posts: 459
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by krohnathlonman
Could you give us some more information on this as well as anything else that can speed the import process up... So far I've just been tossing SCSI drives at it and simply waiting LOL
To delete the old index:

ALTER TABLE `post` DROP INDEX `msgid`;

and to add a partial index for msgid:

ALTER TABLE `post` ADD INDEX ( `msgid` ( 10 ) ) ;

10 means instead of indexing the whole length of the field (128), we only index the first 10 charactors. This will reduce the size of the index. The full length index is fastest at the time of retrieving, a partial index means the DB engine needs to read more lines at the time of retrieving but needs less work at writing.

To people who needs to import large amount of posts in one go. I think if you disable the index building process at the time of importing, it will speed up a lot. You can then rebuild the index using the AdminCP. Bear in mind, rebuilding the index takes a VERY long time. The total time used to rebuild the index should be less than the time used to import large amount of messages and build the index at the same time. I have not done this, this is only base on the theory that it is very slow to insert records into a fulltext index table, and it is faster to build the fulltext index after all the insertions are done.

If you do not need to search the imported messages, then disabling the index build will surely speed up the import. To do this, just comment out

build_post_index($postid, $foruminfo);

line in the /include/functions_nntp.php
Reply With Quote
 
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01189 seconds
  • Memory Usage 1,765KB
  • Queries Executed 11 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD_SHOWPOST
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)bbcode_quote
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)post_thanks_box
  • (1)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (1)post_thanks_postbit_info
  • (1)postbit
  • (1)postbit_onlinestatus
  • (1)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • reputationlevel
  • showthread
Included Files:
  • ./showpost.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_postinfo_query
  • fetch_postinfo
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showpost_start
  • bbcode_fetch_tags
  • bbcode_create
  • postbit_factory
  • showpost_post
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • fetch_musername
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • showpost_complete