There's several things you could do, I'm sure.
One would be changing the AmdinCP and ModCP locations. Rename those folders to something different, and then change:
PHP Code:
$config['Misc']['admincpdir'] = 'admincp';
$config['Misc']['modcpdir'] = 'modcp';
to reflect your changes.
[EDIT] That's in
config.php
Choose a strong password for your account, and make sure your Staff does the same for their accounts. Maybe require the Staff to change their password every X amount of days.