azure-data-factorylimit

Azure Data Factory Copy Operation Character Limit for the Query Pane to copy data


I am looking to identify the character limit while entering a query (beyond which the pane will not take more strings) in the Azure Data Factory copy operation. I tried looking up on the official Azure Data Factory documentation around limits but could not find any.

Grateful if anyone can provide like to documentation where it is stated.

I looked here but couldn't find one.

enter image description here


Solution

  • As per this MS Documentation,

    The Default and Maximum character limitation per any expression of ADF pipeline is 8192.

    If you include any pipeline expressions in your query, then the character limit will be 8192 characters.

    But it's still undocumented when it comes to constant query without any ADF expressions. AFAIK, the constant query character limit and ADF pipeline string variables character limit might be same and as per this SO answer by @Leon Yue, up to 16M characters there is no issue in case of variables.

    Also, to avoid the query characters limitation errors and if your query is too large, it's better to have it in a store procedure in your database and call the stored procedure via your query exec <stored_procedure_name>;.

    enter image description here