I'm trying to create a dynamic dataflow that gets data using a dynamic query that is pass as a parameter and then I want to upsert and delete in a dynamically defined sink table. I'm having troubles with setting the sink dynamic. is it possible? how can I do it? I see no option to have a dynamic target table. what I was thinking was to add another parameter with the sink tablename and use it.
High level view of the dataflow
[Source gets data given sql query ] (OK)
[transformations in the middle] (OK)
[Sink to a dynamic table, that needs to be parameterized but I cannot find a way] (NOT OK)
You can create a parameter in Sink Dataset and then pass the table name as parameter from dataflow activity to Sink Dataset.
Step: