mounting holster on ballistic vest?

hi, i wear an exposed ballistic vest (IIIA) for work, and i want to transition from carrying my sidearm from hip to chest.... my holster has a paddle attachment which easily slides into the chest area of the vest... it has a clamping action which holds it in to place, will this cause any damage to the material of my vest??