netflix-metaflow

get s3 url path of metaflow artifact

Is there a way to get the full s3 url path of a metaflow artifact, which was stored in a step?

I looked at Metaflow's DataArtifact class but didn't see an obvious s3 path property.

Solution

  • Yep, you can do

    Flow('MyFlow')[42]['foo'].task.artifacts.bar._object['location']

    where MyFlow is the name of your flow, 42 is the run ID, foo is the step under consideration and bar is the artifact from that step.