No need to remove anything so long as you keep it updated at all times. Software can become vulnerable(exploits found) but usually they're patched rather quickly.
It's those who run websites, forums, and more that just install software and forget about it that run into issues. I'm still working on sites today that have files from 2012 present and the software isn't compatible with anything higher than php5.4, it's the sheer oversight and lack-there-of (in regards to caring) that make sites vulnerable. Do you buy a car and never changes the oil or brakes? What will happen if you don't do routine maintenance on a car? Case in point the analogy holds true in comparison to software both online and on your computer

.