azure-data-factorydoublekqlinfinity

ADF Copy activity is making double column in adx as "infinity" for 1.7976931348623157E308 value


We are trying to convert the delta into adx in which we have delta column double type and data in it is "1.7976931348623157E308" which is double max value, and using copy activity we need to put this data into adx kusto, in kusto the values is "infinity", want to know the reason behind and how to tackle this.

but adding the value directly in kusto via ingestion works fine. strange...

enter image description here


Solution

  • enter image description here

    To copy your double column value as it is you use data flow instead of copy activity.

    Add your delta table as source and ADX database as sink in your dataflow, create pipeline with dataflow activity, select created dataflow, after dataflow debug you will be able copy the data as it is.

    ['tableName']
    |  project  <columnName> 
    

    enter image description here

    For more information you can refer to the MS document.