palantir-foundryfoundry-code-repositories

How do I ensure a build has consistent provenance records so it can run incrementally?


A transform is building snapshot instead of incremental.
Essentially the same transform is building incrementally in another project.

Foundry gives the reason:

Provenance records for the previous build are inconsistent

What does this mean? How can I ensure the provenance is consistent?


Solution

  • Long-shot: Your incremental transform has multiple outputs, and you are aborting one of your outputs while still writing a transaction to the other(s) ?

    If so, you need to abort all output datasets or write to all, but doing it partially is what makes it "inconsistent".