azureazure-stream-analyticsstream-analytics

How to read a large JSON file as input for Azure Stream Analytics

I am providing a JSON file of 5 MB size as input for Azure Stream Analytics and i am getting the below error.

"selected file 'filename' must be between 1 and 2097152 bytes"

Number of streaming units selected is 3. How to make Stream Analytics to read a large Json file as input?

Solution

  • I think it's limitation for the test of ASA job,you can upload the json file in the Query Editor below 2M only.

    enter image description here

    Based on the statements in the official document.

    For scenarios with large quantities of unstructured data to store in the cloud, Azure Blob storage offers a cost-effective and scalable solution. Data in Blob storage is usually considered data at rest; however, blob data can be processed as a data stream by Stream Analytics.

    I suggest you storing large size json file into blob storage and it will be processed as data stream.