palantir-foundryfoundry-code-repositoriesfoundry-code-workbooks

How do I know my Foundry Job is using AQE?


I hear people mention this AQE feature sometimes and I'm wondering how to verify if my job is using it or not. I'm running transformations both in Code Repositories and Code Workbooks.


Solution

  • This is noted in the Environment details tab of a job.

    1. Navigate to Builds page

    Builds page

    1. Find your running Build in the Build page. Click on it.

    Find your Build

    1. Find your relevant Job inside your Build's page. Click on it.
    2. In the expanded view under your Job, click on the Spark Details button

    Spark Details

    1. Click on the Environment tab

    Environment Tab

    1. Look for a row for adaptiveExecutionEnabled. If true, you are using AQE. If false then you are not.

    AQE Enabled