Those links are only displayed for usergroups that have rights to do mod of admin stuff. Guests and Registred users don't see those links.
I don't see a security issue in that?
I will not agree with that If you use 'Inspect Element' option in any kind of browser you'll be able to see those links