google-cloud-platformgoogle-bigquerydouble-click-advertising

Move BigQuery Data Transfer Service(DCM) data to another project


I have BigQuery Data Transfer Service for Campaign Manager setup in dataset A in GCP project A. I would like to move this to dataset B located in project B. How can I move the existing data and setup the BigQuery Transfer with any loss of data and duplicates?


Solution

  • Here's how I migrated the transfer service:

    1. The transfer service was enabled in the project B.
    2. Once the data started to arrive at dataset B, the historical data(from the starting till MIN(partition_date)-1) was copied from dataset A to appropriate partitions in dataset B.
    3. The transfer service in project A was stopped after verifying the partition counts and row counts.