dataform

Customize Dataform run calls with variables


Is it possible to tell dataform to run a flow (the SQL query) with custom parameters provided by me? Something like: curl my_flow --start_date=20220101 --end_date=20220801 and this vars will be used inside my query.


Solution

  • I've got a response from Liam Binns-Conroy (the Dataform slack community). Thanks to him.

    You can use custom variables to specify params in the dataform.json file, and then pass values in using the dataform CLI vars flag. You then reference the values in the sqlx file like this dataform.projectConfig.vars.myVariableName