Why did he laugh at other guys, that like me?

There is this guy at work, he is quite handsome but quiet and reserved. Almost rude, although he talks to me sometimes, yet rarely. One time he said to me "its so pathetic how many guys follow you around." Than he laughed and walked away. I am attractive and I know a lot of guys do like me. What was the meaning of him saying that though?