My personal preference is a fine Skyforge steel sword. I prefer it because I think it's a great all-purpose blade — it works well whether you're parrying out in a field or clearing a room full of bandits. It's certainly an improvement over an iron sword.
So, what about you? What's your preferred weapon in Skyrim, and why?