How long should it take to backup to spaces? What is the expected transfer rate in Mbit/s?

April 15, 2018 643 views
Backups Ubuntu 16.04

When backing up around 2TB of data with s3cmd from a volume to a space - how long should that be expected to take? What are the bottlenecks?

After 20 minutes nothing has appeared on the space, and the first file is about 7GB. From that it can be deduced the xfer speed must at least be slower than 45Mbits/second - is this normal? What transfer speed is expected? (It would take 4+ days to backup 2TB at this rate.)

Or should I not be using spaces, is there some better option? I just want the data backed up in a timely fashion, and I don't want to pay online SSD rates for it.

2 comments
  • Wow, it's been an hour and still the first file is not there - can someone tell me if this is normal, and what speed should be expected? (I did test with a small file to begin with, and that arrived fine.)

  • Pfft, I just got a 503, after submitting one directory request manually, roughly every 10 minutes. Does this service even work?

2 Answers

Backups should be off-site with a different provider.

  • Thanks for your answer. That depends on how irreplaceable the data is. In this case its a nuisance to recreate the data, not an irretrievable loss - backing up to the same provider is fine, even ideal. This is because the main concern is that the backup happens quickly, and is cheap to maintain.

    My main question however is how long should this take?

There are no published rate limits or speeds for this product.

I have found the performance isn't suitable for production. I hope they improve the product.

Have another answer? Share your knowledge.