google-cloud-platformgoogle-cloud-rungoogle-workflows

Google Cloud Workflows fails with timeout error

Current setup/scenario: I have a google cloud workflow that triggers or runs a Cloud Run Job (not service). But the job runs for about an hour. So, the workflow, after 30 minutes, fails with a timeout error.

My questions:

  1. In the workflow YAML, how can I just trigger the Cloud Run Job and exit immediately without waiting?
  2. In the workflow YAML, how can I then keep on checking the status and sleep for a while until the triggered Cloud Run Job is complete (either successful or failed)?

Please help!

Solution

  • I have added the following in the yaml

                connector_params:
                timeout: 5000
                polling_policy:
                    initial_delay: 900
                    multiplier: 1
                    max_delay: 900

    This is as per the documentation available here. https://cloud.google.com/workflows/docs/reference/googleapis

    I am not sure whether this feature was available when I raised the question. Thanks everyone who tried to help me! I am grateful to you.