Miscellaneous Hacks - ImpEx Module: Xenforo

This is a Xenforo module for ImpEx, the vBulletin Import System,
it does allow you to import a Xenforo Database into a vBulletin 4 installation.

Currently, the following data will be imported:

• Usergroups
• Users including Avatars
• Forums
• Threads including Polls
• Posts
• Smilies
• Attachments
• Conversations
  As vBulletin does not have an equivalent to the Conversations feature in Xenforo, conversations will be converted to Private Messages in vBulletin.
  Please note that any attachments used in conversations will get lost as vBulletin does not (yet) support attachments in PMs.

This module has been developed for Xenforo 1.0.4, but it should also work with Xenforo 1.1.X.
Please not that Xenforo 1.1.X features (Profile Fields, Thread Prefixes, etc.) are not yet supported.

If there is enough interest I might add those features in a later release.

Warning
This module is BETA and has not been tested extensively - use it at your own risk.
If you find bugs, please report them!

Important - See Post #87 about an important potential security issue and fix if you use this.

[iBaker]

I am just about to run a test instance however the first thing that is displayed in impex before I even start importing is:

Warning: session_start() [function.session-start]: Cannot send session cache limiter - headers already sent (output started at [path]/impex/ImpExFunction.php:522) in [path]/includes/facebook/facebook.php on line 37

[iBaker]

I have finished a test run...very test only run to see what problems come up.

1. Firstly there is the error message across the top of the impex page that I posted about just above
2. As far as tables go, it reported 2 tables not found:
xf_identity_service NOT found.
xf_user_identity NOT found.
3. The Attachments path I just could not get right. I tried echoing the path and it showed the correct web address for the internal_data/attachments of the source web site but it failed on all attachments. I copied the source attachments folder to a folder in the target domain (i.e. vb site) and used the path /home/xxx/public_html/source_att/attachments/ and that worked for about 500 attachments out of 14,500

NOTES:
I am using XF v1.1.2 and vb v4.2 PL1
I run a dedicated server using WHM/cPanel and both domains (source and target) are on the same server
My XF site has 7,000 users, 25,000 Threads and 180,000 Posts

Andreas, if you want to test it all with access to the source and target domains let me know

[big dan]

Thanks for the great addon Andreas!

I'm seeing a problem running the import forums module.

The last forum errors out with

ImpEx Database error

mysql error: Invalid SQL: 
					UPDATE forum
					SET parentid = 366
					WHERE forumid = 369
				

mysql error: Table 'xxxxx_vbulldev.forum' doesn't exist

mysql error number: 1146

Date: Thursday 05th 2012f July 2012 03:31:07 PM
Database: xxxxxx_vbulldev
MySQL error:

[Sadikb]

If importing in a new VB instance, does this retain the same IDs (thread_id, forum_id etc) as the ones used in XF or not?

[ragtek]

"bug" in 000.php

PHP Code:

function parent_id_update($Source_Db_object, $Target_Db_object, $Source_tableprefix, $Target_tableprefix)
    {
        // mapping table: importforumid => forumid
        $importforums = array();
        
        $forums = $Target_Db_object->query("
            SELECT forumid, importforumid, importcategoryid
            FROM {$Target_tableprefix}forum
            WHERE importforumid != 0 OR importcategoryid != 0
        ");
        while ($forum = $Target_Db_object->fetch_array($forums))
        {
            if ($forum['importcategoryid'] > 0)
            {
                $importforums[$forum['importcategoryid']] = $forum['forumid'];
            }
            else
            {
                $importforums[$forum['importforumid']] = $forum['forumid'];
            }
        
            $forumcache[$forum['forumid']] = $forum;
        }
        
        // mapping table: nodeid -> parentnodeid
        $parentnodes = array();
        
        $nodes = $Source_Db_object->query("
            SELECT node_id, parent_node_id
            FROM {$Source_tableprefix}node
        ");
        while ($node = $Source_Db_object->fetch_array($nodes))
        {
            $parentnodes[$node['node_id']] = $node['parent_node_id'];
        }
        
        foreach ($forumcache AS $forumid => $forum)
        {
            if ($forum['importcategoryid'] > 0)
            {
                $importid = $forum['importcategoryid'];
            }
            else
            {
                $importid = $forum['importforumid'];
            }
            
            if (isset($parentnodes[$importid]) AND isset($importforums[$parentnodes[$importid]]))
            {
                $Target_Db_object->query("
                    UPDATE {$tableprefix}forum
                    SET parentid = " . $importforums[$parentnodes[$importid]] . "
                    WHERE forumid = $forumid
                ");
            }
        }
    } 


should be

PHP Code:

function parent_id_update($Source_Db_object, $Target_Db_object, $Source_tableprefix, $Target_tableprefix)
    {
        // mapping table: importforumid => forumid
        $importforums = array();
        
        $forums = $Target_Db_object->query("
            SELECT forumid, importforumid, importcategoryid
            FROM {$Target_tableprefix}forum
            WHERE importforumid != 0 OR importcategoryid != 0
        ");
        while ($forum = $Target_Db_object->fetch_array($forums))
        {
            if ($forum['importcategoryid'] > 0)
            {
                $importforums[$forum['importcategoryid']] = $forum['forumid'];
            }
            else
            {
                $importforums[$forum['importforumid']] = $forum['forumid'];
            }
        
            $forumcache[$forum['forumid']] = $forum;
        }
        
        // mapping table: nodeid -> parentnodeid
        $parentnodes = array();
        
        $nodes = $Source_Db_object->query("
            SELECT node_id, parent_node_id
            FROM {$Source_tableprefix}node
        ");
        while ($node = $Source_Db_object->fetch_array($nodes))
        {
            $parentnodes[$node['node_id']] = $node['parent_node_id'];
        }
        
        foreach ($forumcache AS $forumid => $forum)
        {
            if ($forum['importcategoryid'] > 0)
            {
                $importid = $forum['importcategoryid'];
            }
            else
            {
                $importid = $forum['importforumid'];
            }
            
            if (isset($parentnodes[$importid]) AND isset($importforums[$parentnodes[$importid]]))
            {
                $Target_Db_object->query("
                    UPDATE {$Target_tableprefix}forum
                    SET parentid = " . $importforums[$parentnodes[$importid]] . "
                    WHERE forumid = $forumid
                ");
            }
        }
    } 


the last prefix is wrong

[Paul M]

I cannot see any difference between the two bits of code, you probably want to make it more obvious.

[big dan]

Thanks Ragtek! That fixed my forums import issue. :up:

[ragtek]

Originally Posted by Paul M

I cannot see any difference between the two bits of code, you probably want to make it more obvious.

the last prefix is wrong

PHP Code:

 if (isset($parentnodes[$importid]) AND isset($importforums[$parentnodes[$importid]]))
            {
                $Target_Db_object->query("
                    UPDATE {$tableprefix}forum
                    SET parentid = " . $importforums[$parentnodes[$importid]] . "
                    WHERE forumid = $forumid
                ");
            } 


vs

PHP Code:

if (isset($parentnodes[$importid]) AND isset($importforums[$parentnodes[$importid]]))
            {
                $Target_Db_object->query("
                    UPDATE {$Target_tableprefix}forum
                    SET parentid = " . $importforums[$parentnodes[$importid]] . "
                    WHERE forumid = $forumid
                ");
            } 


[merk_aus]

So what is the best way to get passwords to work?

[big dan]

Originally Posted by merk_aus

So what is the best way to get passwords to work?

After importing email your members with the password reset link. That's what I did. It wasn't too bad.