I see... My only concern at the moment is how Joomla is quite a lot more complex - both a good and bad thing. Obviously better in terms of features and how powerful it can be, but I can see it becoming an issue when it comes to maintenance and the pressure on the server. I'm no way a master at websites yet so dealing with the complexity of Joomla when/if an issue arises wouldn't be that fun.
Still, I'll take a better look around before deciding. I've used Joomla and know how great it can be for certain sites but might not work in context with what I want to do with it. The smaller learning curve of WP means its more likely I can get it to where I want faster, and who knows, maybe I'll just use it as the launch pad for later Joomla use.