airflow

Problem with tasks and tasks groups order on the GRID VIEW on airflow 3.0.1


I have tasks executed by Airflow on the correct order. It works on Airflow with the versions 2.11.0 and 3.0.1.

My problem is the order of the tasks and tasks groups on the GRID VIEW on 3.0.1.

I tried to change the grid_view_sorting_order value from topological to hierarchical_alphabetical on the airflow.cfg file, it goes from :

topological

to

hierarchical

which is not what I want (for example, the task group SETUP should be before the task group ETL, also the tasks groups 0_json_in_folder and 1_json_in_folder are shown on top of the task group transforms_and_load_to_json although they should show after the task A6_0_or_1_json_on_setup).

What I would like is having the same grid view (with the same tasks and tasks groups order) as the one I had on 2.11.0 :

2.11.0

Note that the 3.0.1 graph is coherent with what I want to do (same with the one I had on 2.11.0) :

enter image description here

Is there a way to configure the GRID VIEW on 3.0.1 like it was on 2.11.0 ?


Solution

  • I figured out I don't have this issue on 3.0.1 anymore with the appropriate bitshift operators for the tasks dependencies. I already had some of them, but I think some of them were missing.

    I was a bit confused because :

    Now I have the grid view matching the graph view :

    grid view