Files keep reappearing in iMac downloads folder?

How do I stop some folders and files from reappearing here? They have been put to the trash twice now, but within a few minutes are there again in the Downloas folder. Please can anyone suggest a fix?