I am using Metaflow on AWS in batch mode. I deleted the conda folder from s3. Now when I try to run a batch task, it fails in the bootstrapping environment step.
Apparently metaflow.plugins.conda.batch_bootstrap tries to download conda packages using the cache_urls associated with the environment id from the conda.dependencies file. The issue is described in some more detail here.
How can I fix this problem so that I can run a metaflow batch task again?
@kanimbla metaflow maintains a manifest folder .metaflow either in the same directory as your flow or in one of the parent directories. Deleting it resets your flow's dependencies.