So i've been replaying the series and have forgotten a few things about the mechanics of loyalty missions and when the game becomes "timed". Preferably i'd like to save everyone, and one problem I had with my first playthrough was not being able to see a lot of the latter squad-members because of it; I did everyone's loyalty missions as soon as they became available, which meant a lot of palling around with Jacob, Miranda and Garrus, but almost no time to hang out with Samara, Thane or Legion. This time around, i'd like to mix things up by bringing different crew members along to Loyalty missions/side-missions, to keep things interesting.
That said, i'm aware that there is a point in the game where if I start fucking around with side-missions, I end up getting Kelly and some of my crew killed. Hence my question; will there be a point in the game where I will have all of the squad-members and be able to go around doing their loyalty missions WITHOUT being punished for wasting time? Or do I really have to do all the Loyalty missions ASAP?