palantir-foundrypalantir-foundry-api

Rest API: Is there any endpoint that provides dataset lineage info?


I was not able to find an endpoint that can provide information about datasets dependencies.

Example: I would like to same (but simplified) info as I do with lineage about Dataset A depending on B and C via Pipeline P / code repository X?


Solution

  • You can always see the network requests that populate the data in the data lineage.

    If you expand the lineage downstream it uses the endpoint you can call using requests like this:

    requests.post(f'{FOUNDRY_URL}/provenance/api/provenance/containers/graph',
                  data={
                      'type': 'downstreamRequest',
                      'downstreamRequest': {
                          'downstreamResourceLabels': {},
                          'rootContainer': yourDatasetRid,
                          'upstreamResourceLabels': {}
                        })
    

    And there is the equivalent for the upstream lineage.