Question
Question
Uploading millions of small files to spaces very slow
I use aws s3 sync with high success and same speed as an actual aws s3. However, now that I have millions of small files, many either keep failing, or the speed is so ridiculously slow. After running a full day, I’ve only uploaded ~1GB of 60. I can’t wait 2 months for this data to upload.
Any suggestions?
Add a comment
These answers are provided by our Community. If you find them useful, show some love by clicking the heart. If you run into issues leave a comment, or add your own answer to help others.
×