google-bigquerygoogle-cloud-data-transfer

BigQuery - data transfer success but destination table stays empty


Final goal: transfer csv file contents from google cloud storage bucket to a table in BigQuery dataset.

problem: data transfer seems to be working, not showing any errors/warnings but the data fails to reach the destination table.

i'm new to bigQuery and GCP but the idea of data transfer seems pretty intuitive to me. i assume i'm missing something here but the flow does not notify me. so i thought it might be permissions (i have bigQuery Admin role among other so..) i thought its a location/region thing but all resources are in EU..

can you help me understand what else am i missing ? attaching some pics that might help.

Bucket Configuration (where my csv resides)

Destination Table details

Transfer Configuration

Data Transfer output showing a successful action

Thanks in advance.


Solution

  • please have minimum 'BigQuery Data Editor' role on your id to solve your problem.