Is feeling guilty about something a sign of caring?

A guy friend a comment about me which hurt my feelings. He didnt know he hurt my feelings until recently. We have only known each other for 3 months and were still getting to know each other. I can tell he felt guilty cos he kept apologising for what he had said and telling me that he wants to take his words back. Does this means he area about me if he did this?