Generally why wouldn't he be allowed to defend himself? As long as it's a rational discussion I'd allow it. However, if he (or another member) becomes disruptive on the forum and/or breaks the rules you certainly have every right to temp / perm ban him. If you ever have to delete posts, SOFT delete them in case you need to refer to them later.
In otherwords, give him the opportunity to shove his foot in his mouth