This same scenario, albeit with a few differences, happened to me in Fallout 3. I spread myself too thin, and restarted with a more focused build.
I've made my character, and I've been fine being a conjuring, sword and ice using, battle mage, but now I've realized that I've tried to do to many things, and now enemies are steam rolling me. I know I could just lower the difficulty, but I'm not a pansy.
I was wondering if any one else was doing this as well.