google-cloud-platformgoogle-cloud-storageapache-nificloud-storage

Problem adding duplicate object in Google Storage using PutGCSObject processor in Nifi


I am using Nifi to send data from Pub/Sub queue to Cloud storage. I'm using the ConsumeGCPubSub processor to fetch data from the queue and the PutGCSObject processor to add Cloud Storage in Nifi. But the PutGCSObject processor is sending duplicate data in Cloud Storage.

I also see that this data has the same MD5 Hash code in its Cloud Storage records. What could be causing this and how can I fix it?

Scheduling Properties

I double checked:


Solution

  • You should have connected the success criterion on the terminate side to the processor.