You should always attempt to broaden your horizons. You should never feel ashamed about your choice in music. Or just about anything else, for that matter.
Enjoy what you like and don't be afraid to try something new. Music genres, movies, food, whatever. My philosophy is to give just about everything a shot at least once. If it turns out that you don't like something different, it won't hamper your enjoyment of the things you already love.
TL;DR - YOLO!