I am trying to sink data to a delta file. I want to use a insert and update method using the unique Id column: (sink settings)
Whenever the update method is allowed a AlterRow operation will appear. I have the following settings for the alterRow:
I want a row to be updated whenever the id value is the same (set to true()). I want a row to be inserted whenever the id value is not yet in the delta file (set to false().
Is this correct?
If you want inserting when the id doesn't exist and updating when it does, you could just select upsert as your update method.
An upsert is a combination of an insert and an update.
The way you've currently got it configured means that it will always update (as it's set to true) and will never insert (as it's set to false).