Question
What's the fast way to Upload my 2TB contents onto DO spaces?
- Posted on November 5, 2023
- Block StorageBuilding on DigitalOceanCommunityDigitalOcean Spaces
Asked by newuser23
I need to upload 2TB of content to DO Spaces. The average file size ranges from 15GB to 20GB. What is the quickest method to upload everything? My upload speed is approximately 200Mbps. I’m currently using rclone to upload some files, but the upload speed doesn’t exceed 5Mbps. With my previous provider, I shipped a hard drive, and they transferred the data within a day. Does DO offer this option as well?
This textbox defaults to using Markdown to format your answer.
You can type !ref in this text area to quickly search our full set of tutorials, documentation & marketplace offerings and insert the link!
These answers are provided by our Community. If you find them useful, show some love by clicking the heart. If you run into issues leave a comment, or add your own answer to help others.
Get our biweekly newsletter
Sign up for Infrastructure as a Newsletter.
Hollie's Hub for Good
Working on improving health and education, reducing inequality, and spurring economic growth? We'd like to help.
Become a contributor
Get paid to write technical tutorials and select a tech-focused charity to receive a matching donation.
Hi there,
What you could try with
rcloneis to increase the number of concurrent uploads. Rclone allows you to do this with the--transfersflag.Along with that you could try out the
--s3-chunk-sizeand--s3-upload-concurrencyflags with different values to optimize upload speeds.I believe that DigitalOcean does not offer a service to physically ship a hard drive for data transfer, but you can reach out to the support team who might be able to provide you with more details on that:
Hope that helps!
- Bobby.