google-bigquerycrashlytics

BigQuery Data transfer crashes with error INVALID_ARGUMENT: Creating table with tags is not supported


I have crashlytics being synchronized in BigQuery and I have a Data transfer job configured to copy its data from US to EU region. It was working great for years and now I got an error, since 1 week.

That Data transfer is a simple "Dataset Copy", from source "firebase_crashlytics" (in US), to destination "firebase_crashlytics_eu". I guess this is the usual way to synchronize Crashlytics data to BigQuery EU. Nothing fantastic here ;)

Yet, my jobs fail with this error:

BigQuery job bqts_66b11d31-0000-2c97-be17-582429cc3f48 (table com_XXXX_IOS_REALTIME) failed with error INVALID_ARGUMENT: Creating table with tags is not supported.; JobID: XXXXX:bqts_66b11d31-0000-2c97-be17-582429cc3f48. Check BigQuery job details for more information.

When I check that BigQuery job details, nothing special there.

I have no clue what this "table with tags" means. My source tables or dataset have no tag, my columns have no "policy tag". This error Creating table with tags is not supported makes no sense to me.

Any idea?


Solution

  • I spoke with GCP Support about this bug, which is affecting many people.

    A root cause fix is underway, but it seems clear that

    1. the data transfer service doesn't support cross-region copy for tables with tags
    2. for some reason, the system mistakenly believes that certain tables have tags, even though they do not (and the UI says they do not)

    Since (2) is the case, GCP Support told me you can fix your problem by removing the (nonexistent) tags. It's simple:

    This unblocked things for us.