As soon as a fish dies, their body starts to break down and the meat becomes bad. You NEVER want to leave fish out at room temperature because you run the risk of contracting a food borne illness. Leave the fish in refrigeration until you are ready to prepare and eat it.
