Scared to lift light but very motivated to heavy lifting...?

I know tottally opposite... i should be scared to lift heavy but actually i am afraid to lift light weights. I workout for 320 pounds for 3-5 reps on deadlift. But I never ever tried weight lifting 120 pounds. I want to know how it would feel? But I'm scared to. I don't know if I'm worrying too much or what