I am working on a pipeline using Vertex AI, and I'm facing an issue with scheduling the execution of two components with a delay. Here's the scenario:
My question is, how can I set up this delay between Component B and Component C in the pipeline?
I have considered using the pipeline orchestration capabilities provided by Vertex AI, but I couldn't find a built-in feature for adding such delays between components. I also looked into using Cloud Scheduler, but it seems more suitable for triggering pipeline runs rather than introducing delays within a pipeline.
I would greatly appreciate any insights or suggestions on how to accomplish this delay between the execution of Component B and Component C in the Vertex AI pipeline. Thank you in advance for your help!
I'd recommend having a separate pipeline for component C. When the component B in the first pipeline completes, publish a message to PuSub and then trigger the Pipeline of Component C with that message in PubSub. For more info: https://cloud.google.com/vertex-ai/docs/pipelines/trigger-pubsub