amazon-s3rclone

Prevent rclone from re-copying files to AWS S3 Deep Archive


I'm using rclone in order to copy some files to an S3 bucket (deep archive). The command I'm using is:

rclone copy --ignore-existing --progress --max-delete 0 "/var/vmail" foo-backups:foo-backups/vmail

This is making rclone to copy files that I know for sure that already exist in the bucket. I tried removing the --ignore-existing flag (which IMHO is badly named, as it does exactly the opposite of what you'd initially expect), but I still get the same behaviour.

I also tried adding --size-only, but the "bug" doesn't get fixed.

How can I make rclone copy only new files?


Solution

  • It turned out to be a bug in rclone. https://github.com/rclone/rclone/issues/3834