Deleted messages and attachments are saved by default until you exit from Mail. You can choose to discard (destroy) the deleted items during a Mail session by selecting Discard Deleted from the Edit menu. After you discard deleted messages they are permanently gone.