azure-data-factorypipelinedata-ingestion

Ingesting data from an API and webactivity


I need to ingest data from 3 endpoints. my pipeline is as follows: a web activity to obtain authentication to the api via a post request and 3 web activities to retrieve the data via a get request. I would need to ingest data from these 3 web activities to a location in the raw zone . How can I achieve this?

pipeline with three endpoints

I have managed to make the API calls and get a response. But have no knowledge on how to proceed further


Solution

  • You can directly use copy activity with Http connector to call your endpoints. and add it as source and the select appropriate sink. and copy the data

    enter image description here

    enter image description here

    OR