Headaches from wearing headphones too much

I get crazy headaches from wearing my over the ear headphones for hours and hours a day. The strange thing is that I've begun to get, I guess "phantom headphone pressure" hours and sometimes days after taking them off. I haven't worn them for about two week and it seems to have subsided.

Anyone else has a similar issue?

How did you deal with it?

I don't like the idea of not wearing headphones, as I usually annoy the shit out of anyone around me that doesn't like dubstep. In-ear monitors have been pretty fail in the past. I had a set of Beats in-ear and even the small ear cushion that came with them made my ear hurt to the point I had to return them.