amazon-s3s3cmd

S3cmd sync returns "killed"


I am trying to sync a few large buckets on amazon S3.

When I run my S3cmd sync --recursive command I get a response saying "killed".

What does this refer to? Is there a limit on the number of files that can be synced in S3?


Solution

  • After reading around it looks like the program has memory consumption issues. In particular this can cause the OOM killer (out of memory killer) to take down the process and prevent the system from getting bogged down. A quick look at dmesg after the process is killed will generally show if this is the case or not.

    With that in mind I would ensure you're on the latest release, which notes memory consumption issues being solved in the release notes.