azureazure-data-factoryazure-table-storagedata-migrationazure-storage-account

Azure Data Factory, table storage copy Binary data results in System.Byte[] output


We are moving large amounts of data from one table store to another table store in other region and subscription.

I have set up a pipeline for copying the data in Azure Data Factory, which seemed like the easiest and fastest route to go.

All data seem to be able to copy correctly except one column with Binary data.

I have set up a mapping like this: mapping details

But the resulting Value is the string "System.Byte[]":

Resulting table

Source table column:

Source Table


This does not seem like intended behaviour, and wonder if I have missed something or there is a bug with this type of mapping.


Solution

  • I'm having the same problem.

    In this MSDN documentation explaining the way of data transformation I found out there was a "legacy" conversion experience. To enable this experience you should set "typeConversion": false in the JSON. After I did this, all my Byte[] data was copied correctly.

    I have to mention that I use custom column mapping in my solution. Maybe this can help you too.