If you click "Yes" to "Are you sure you want to delete this moderator" it'll just remove them from Moderator, and be sure to go to "Users" and click "Search for user" and type there name in, and move them out of the Moderator group
The "Remove this moderator from all forums, just deletes them from forums to moderate so they no longer get emails about reports and so on.