excelazure-data-factorygoogle-cloud-dataflowazure-synapse-pipeline

Pass filename dynamically in dataflow synapse pipeline - source as excel


I am trying to pass filename as parameter to dataflow in synapse pipeline but facing issues.

I am setting a variable and passing that to dataflow as below.

enter image description here

Also created a parameter inside the dataflow

enter image description here

Also inside source enter image description here

Inside connection given filepath as enter image description here

Wildcard path under source as enter image description here

When I try to import projection getting error. No idea about this, appreciate your help in resolving this. I suspect may be I am doing something wrong in passing parameters?

enter image description here

This is the file which I am trying to access in source enter image description here


Solution

  • If you want to pass filename as parameter to dataflow follow below procedure:

    Create dataset string parameter fileName for dataset as shown below:

    enter image description here

    Create pipeline string parameter fileName with value as shown below:

    enter image description here

    Provide above parameter as set variable value @pipeline().parameters.fileName as shown below:

    enter image description here

    In data flow provide the variable fileName which is created in set variable activity to the data flow @variables('fileName') as shown below:

    enter image description here

    Then you will be able to pass file name successfully without any error.

    Note: No need to create parameters in data flow to pass file name while parameter created in dataset.