Do you think it's wimpy to wear a swim shirt?

I have an eleven year old brother and he had a swim party at his school recently. He came back and said that lots of bullies called him a wimp because he was wearing a swim shirt. He said they teased him about not being manly enough to show his skin. I'm wondering what I should do, because I don't know if you guys think it's wimpy or not.