What can I grow plants in that is not dirt?

I want to grow some birdseed plants for my ratlets to play in and eat, but its winter and the ground is frozen so I cant get any dirt that has no fertilizer. Would wetted paper towels with sugar in the water work? It has to be safe for baby rats to chew and eat and roll in etc. :) thanks!!