Started with the Cane, loved that. After a while, I bought all of the starting weapons, the Kirkhammer and the spear (just past the 2nd boss) and have fallen in love with the Axe.
Rolling with the Axe in 2h mode at all times and the cane for when I need to parry seems like a fantastic combo thus far. No matter what situation I'm in, I have fast attack speed at range and thus can keep almost everything either at bay or knocked the hell down with the Axe's charged R2. Seems almost too strong.
Can't wait to try the holy blade and the daggers though.