Maybe newpost_process will work for you - the post text will be in $post['message']. If you want, your plugin can add a string to the $errors array and it will stop posting of the message and display your error above the editor. (Look in includes/functions_newpost.php if you're interested in seeing where the hook code is executed).