Sometimes I like it, sometimes I don't. In games where I make the decisions, I'd prefer it if my character didn't have a voice. So when I pick my response, I feel like I'm actually responding. If someone else's voice comes out of the character after I've made my response, I no longer feel like it's me making the choice. I don't need an actor to read a line I told them to say in the first place.
But for games that have a more linear story, it can go either way for me. A silent protagonist makes me feel like the world is happening around me, regardless of my input, which can be fun. On the other hand, when a character speaks to me directly and there is no response either by me or the character, it can look awkward.
It's especially weird in games where your character never speaks, but somehow every character in the game hears a response from you. "What's your name? Oh, it's Randy? That's a nice name." How do you know that!? I never said anything! Mind reader!