Is it time to end this relationship?

This guy and I have been in a relationship for over 3 months now. Most of the time its really good, but every so often we have a fight and he has a terrible temper. I usually like to talk about it and solve the problem, while he just yells at me and says negative things about me and tries to leave or just won't talk to me for a while (hours usually, never days or anything). He makes me feel horrible when we fight and I just feel exhausted and negative for days after. Do you think I should stay in this relationship because all relationships take work, or should I leave? We are in our mid 20s.