Planning to use Dataproc cluster with Dataproc Metastore.
Questions:
Posting this as a community wiki:
As what Dagang said, the answer is to use an external metastore that persists outside of the cluster lifecycle. You can do this in two ways:
Using Dataproc Metastore Service
Using Cloud SQL proxy