Two variations, based on if you want random smilies in each group or random smilies from any group respectivly:
In includes/functions_editor.php find:
PHP Code:
LEFT JOIN " . TABLE_PREFIX . "imagecategory AS imagecategory USING(imagecategoryid)
ORDER BY imagecategory.displayorder, smilie.displayorder
Replace with (for random smilies within each group):
PHP Code:
LEFT JOIN " . TABLE_PREFIX . "imagecategory AS imagecategory USING(imagecategoryid)
ORDER BY imagecategory.displayorder, RAND()
Or replace with (for random smilies from any group):
PHP Code:
LEFT JOIN " . TABLE_PREFIX . "imagecategory AS imagecategory USING(imagecategoryid)
ORDER BY RAND()
Untested but should work.