google-cloud-platformgoogle-cloud-dataprochive-metastore

Can multiple GCP Dataproc clusters use same metastore?


Planning to use Dataproc cluster with Dataproc Metastore.

Questions:


Solution

  • Posting this as a community wiki:

    As what Dagang said, the answer is to use an external metastore that persists outside of the cluster lifecycle. You can do this in two ways:

    Using Dataproc Metastore Service

    Using Cloud SQL proxy