airflowcamundaconductor

Microservices orchestration choices


I am exploring the possible solutions for orchestrating my flows across multiple services via some infrastructure. Searching shows me a few options such as Conductor, Camunda, Airflow etc.

I am wondering what would fit my use case better

  1. One of my service is in Java, the other is in Python
  2. I need to pass info to the Java service, then take the output and pass it to the Python service
  3. Final output is then published to another queue

It feels like Conductor is a good choice, but would love to hear your inputs!


Solution

  • All options can fulfill the requirement stated. Think about further / future requirements. Is it only a data pipe? Is it about orchestrating a larger end-to end business process? Do you need support for long-running processes? Is end-to-end transparency in a graphical form a benefit? Is graphical process modelling in BPMN2 standard going to be a benefit? Are there going to be audit or reporting requirements? Or is it going to be a simple, isolated, technical solution?

    This article gives a great overview of tools in the market and what their primary use cases are: https://blog.bernd-ruecker.com/understanding-the-process-automation-landscape-9406fe019d93