Cloud data fusion Permission denied due to datastream.connectionProfiles.discover
I am trying to create a cloud data fusion replication job from oracle to bigquery. Receiving the below error.
Failed to connect to the database due to below error : io.grpc.StatusRuntimeException: PERMISSION_DENIED: Permission 'datastream.connectionProfiles.discover' denied on 'projects/<>/locations/us-central1/connectionProfiles'
Following the steps mentioned in the official google documentation.
I was able to grant the Datastream Admin role to the dataproc service account.
The cloud data fusion service account is not available in this project's IAM page. Not sure how to assign "Datastream Admin role" to the data fusion service account.
Any help is appreciated..
Solution
Found it we assign roles by the above way.
- Flink-BigTable - Any connector?
- Feature Selection in PySpark
- How to get jobId that was submitted using Dataproc Workflow Template
- How can I debug an InactiveRpcError with status INVALID_ARGUMENT when submitting a serverless batch job?
- Creating Dataproc Cluster with public-ip-address using DataprocCreateClusterOperator in Airflow
- Spark The deserializer is not supported: need a(n) "ARRAY" field but got "MAP<STRING, STRING>"
- Pyspark on GCP Dataproc - Partial reading of data for gzip encoded Cloud Storage files
- Facing Issue in passing metadata field with DataprocCreateClusterOperator (Airflow 2.0)
- BigQuery scanning cost for Dataproc
- How to resolve: java.lang.NoSuchMethodError: 'scala.collection.Seq org.apache.spark.sql.types.StructType.toAttributes()'
- what's difference between dataproc cluster on GKE vs Compute engine?
- Interacting with Dataproc Serverless using Dataproc Client Library
- Specify connector version when initializing a cluster with 'clusters.create' API
- Unable to change the timeout value for dbt dataproc serverless job
- Error in publishing data to pubSub from dataProc Spark job: No functional channel service provider found
- Iceberg table snapshots not expired
- How can I process this Dataproc job faster?
- Fixed host name for Dataproc component gateway
- Hadoop fs configurations in Dataproc spark code
- Dataproc: configure Spark driver and executor log4j properties
- Use Google Cloud Workflows to trigger Dataproc Batch job
- How to do a clean installation of an upgraded version of Spark on Dataproc
- Dataproc: dependency on cluster's HDFS when submitting Spark job to YARN from an edge node
- Spark job `Container killed on request. Exit code is 137` on Dataproc 2.0
- Submit command line arguments to a pyspark job on airflow
- Filtering GCP dataproc batches list by createTime doesn't work
- Spark process running without disk error exception
- Role of additional disk on top of default VM sizing
- spark.sql.shuffle.partitions - default value
- Scala Spark Job in Dataproc cluster returns java.util.NoSuchElementException: None.get