I took up swimming, can I lose belly fat without losing weight?

I have never been phsyically active for long periods of time. Now recently I took up swimming in order to reduce my belly fat. Will this help my belly in any way without really losing much weight? I alleady think I'm really skinny other than at my belly. Currently my belly is around 79 cm waist size (31.1 inches), I'm 1 m 78 tall ( 71 ~inches) and weight 61 kg (134 lbs) I have a fat % of roughly 16-17% , which I want to get down by doing this physical activity (and no real diet , just not eating too unhealthy) Is it possible to archieve improvement, towards lets say 10-12 % BF (and less flab belly) by training swimming three days a week for roughly 45min ~ 1 h a session while maintaining or increasing my weight? And how long would it take on average to actually see it improve? Note: i have a mild pectus excavatum (funnel chest) and so the belly looks even more bloated because of it