The only instance where controlling the game actively pissed me off was a puzzle sequence where you have to hit 3 bells with your throwing axe in quick succession and it included two 180s, precisions aiming and awkward turning.
The valkyrie fight in Alfheim is massive bullshit. I hate how it has some type of bullshit magnetic lock-on with its targeting that makes it almost impossible to evade its attacks. I really wish I could cancel out my attacks after the target has moved. You think you're going to parry or block until its attack turns red, and now you're fucked. I haven't really figured out the attack patterns since they seem completely random and are total bullshit.
As for that chest....if it's the one I think it is, and it's the final one in Alfheim, it's not even worth trying since it's not an apple or horn. The final horn is found in a certain dwarven ruin after an armored dragon crash lands near the world serpent.