Attachments resulting in soft 404 errors

[John Lester]

While guests/users not logged in can not see attachments, they can see the links to them. When the link is accessed it results in a no permission page. Google (and assuming other bots as well) see this as a "soft 404" error page. How do I go about hiding the attachment links from guests/users not logged in?