Azure Data Factory V2 Copy Activity is not cleaning/deleting staged files/containers after copying data to the destination (Like: Snowflake).
Is this a bug? In my ADF, the container level is set for the staging area and I end up with multiple GUID containers. Some containers are even having metadata files.
According to Microsoft, all the temporary files/folders/containers created by Azure Data Factory in the Staging Area should be automatically deleted by the ADF after the Copy is successful.
Please guide.
According to Microsoft, all the temporary files/folders/containers created by Azure Data Factory in the Staging Area should be automatically deleted by the ADF after the Copy is successful.
For stagging we have 2 options for linked service:
Blob storage After stagging:
ADLS After stagging:
Container is not get deleted in either of the storage accounts.