Frequent disconnections with Live Parties?

Does anyone have any problems with disconnections with Live Parties?  Me and my friends are always being disconnected during our live parties for some reason, anyone else having these problems?

This happens all the time.  It seems to be the worst when there are 4 or more people in the party.

Yeah, sometimes it just tosses individuals out of a party, or it splits the party in half or something. It's irritating.