Saturday, August 21, 2021

How to handle data load failure in SSIS?

 There are different ways to handle data load failure. 

1. On dataflow you can redirect failure rows to another location and later retrieve it. 

2. You can also set ignore failure rows on destination settings. 

3. Easiest way is configure destination columns to easily convertible datatype like Varchar/strong with proper length. 

4. If failure can happen due to network issue or connection issues then you can set up retry mechanism. 

5. If it's happening due to memory then you can review the batch size and go for sequential load instead of parallel loads. 

No comments:

Post a Comment

How to load too many small json files to databricks delta table from ADLS ?

 You often come across situation where you have many small json files (telemetry files created by IOT devices) created in your ADLS/Blob Sto...