azureazure-data-factoryazure-synapse

Best approach to trigger Synapse from ADF


I would like to hear from you if my approach is the best out there, or if there are some out of the box solution or better solution when it comes to convenience and security. I have an Azure Data Factory serving as the ingestion tool and there is Synapse Analytics as the transformation (my solution is mostly in Synapse but you cannot share Self Hosted Integration Runtime linked service among synapse workspaces so it would require more amount of VM with SHIR linked services which has been denied as its cost).

Currently the only way I see is WebActivity within ADF pipeline and REST API call to trigger Synapse pipeline. I guess it's pretty decent solution as I've come across that before, but maybe there is something better I can think of? Any recommendation and idea would be highly appreciated

Thank you in advance


Solution

  • Currently, there is no specific activity in ADF to trigger the synapse pipeline. As mentioned, you can either use a REST API to trigger the synapse pipeline or use storage event trigger.