In a SSIS package I have an OLED Source, a look up transformation and an OLE DB destination task. I'm running my package on VS 2019 but the tasks(OLED Source, OLE DB destination) are getting fail after 10 to 15 minutes with below error:
[OLE DB Destination [27]] Error: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80004005.
An OLE DB record is available. Source: "Microsoft SQL Server Native Client 11.0" Hresult: 0x80004005 Description: "Communication link failure".
An OLE DB record is available. Source: "Microsoft SQL Server Native Client 11.0" Hresult: 0x80004005 Description: "TCP Provider: The semaphore timeout period has expired.
".
[OLE DB Destination [27]] Error: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR. The "OLE DB Destination.Inputs[OLE DB Destination Input]" failed because error code 0xC020907B occurred, and the error row disposition on "OLE DB Destination.Inputs[OLE DB Destination Input]" specifies failure on error. An error occurred on the specified object of the specified component. There may be error messages posted before this with more information about the failure.
[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PROCESSINPUTFAILED. The ProcessInput method on component "OLE DB Destination" (27) failed with error code 0xC0209029 while processing input "OLE DB Destination Input" (40). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running. There may be error messages posted before this with more information about the failure.
[OLE DB Source [66]] Error: The attempt to add a row to the Data Flow task buffer failed with error code 0xC0047020.
[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED. The PrimeOutput method on OLE DB Source returned error code 0xC02020C4. The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing. There may be error messages posted before this with more information about the failure.
I tried to fix this issue by setting validateExternalMetadata as false for the tasks but no luck.
I also checked others answers on stack overflow for almost the similar issues/ques. but that also didn't help.
Note: SSIS connection manager is using SQL server authentication and DB is Azure SQL
appreciate your help if any.
From my experience this error can have various reasons. For example this can be caused by the server being overloaded, or due to bad network. One thing you could try is to change the caching mode of your lookup component. I'm assuming it's running in "Full cache" mode, meaning that all the data in the lookups query will be read into memory of the SSIS server before doing the lookup. Changing this to "No cache" for example will result in the lookup query being run for every row that's fed into the component. "Partial cache" will cache, but only as each distinct value is encountered in the data flow. These other methods will put less load on memory of the SSIS server but more load on the lookup source database. If it works one option might be to increase RAM of the SSIS server.