Don't be an idiot and stay too long at the party. If you ditch it when it's starting to turn sour, that's when people will start to think you're 'cool' and a 'busy' type of person. It gives the right impression.
If you have to even think about that, you're not all that cool.
I leave when I want to leave, whether that's early or late depends on the party itself.