It depends. Most mods are written correctly with uninstall code, but that is not guaranteed. You should always read the code, read the install instructions and uninstall instructions (which should be exactly the opposite) and read the thread to make an informed decision about a mod.