Am I dumb to worry about this....?

At my apartment my roomate and I use an old ripped pajama bottom as an oven mit. This morning I woke up to find he put the pajama bottom on top of the burner on the stove. This has been bothering me all day. Is it as big of a deal as I'm making it out to be or am I worrying too much? It just seems unbelievably idiotic and unsafe to me.