Is there/will there be an object storage CLI for DO Spaces?

September 18, 2017 2k views
Storage
weildish
By:
weildish

I've attempted poking around with doctl to see if there is any support for using it as a CLI for the new object storage DO has in beta, but I'm not seeing anything that seem related to this. Documentation doesn't reflect anything yet available, either. I'm using the version compiled by homebrew for MacOS.

I also considered the AWS cli, and while the APIs supposedly are compatible as per docs, the aws CLI internally assumes some things about URLs and regions specific to AWS that make it impossible.

Will there be an update to doctl to allow for CLI access to object storage?

Does anyone know of a compatible CLI tool that could be used in the meantime?

Log In to Comment
3 Answers
xMudrii September 18, 2017
Accepted Answer

Until Spaces don't reach General Availability point, I don't believe we'll see any official CLI. Well, as it's private beta, it's sort of "hidden" from public and sharing information about Spaces is not that advised.

However, this sounds like a great idea and I would love to see sort of official support in doctl.
Maybe creating an issue on GitHub would be a good idea. As always, I would love to help and work on it, but I wouldn't start anything before we get green light on it.

In meanwhile.. s3cmd could be useful. When you create a new Space, you will have welcome.html file in the root. There will be links to the docs which could be useful to you. It even covers s3cmd.

Reply
shua November 7, 2018

The issue with s3cmd is that it does not support parrellel out of the box.
I used the below command. However, DO if you read this please realize ppl like myself transferring 20T of data will need to wait days for all the data to transfer

find . -type f | sed 's|^./||g' | xargs -P 8 -I {} s3cmd put {} s3:///{}
Reply
weildish September 19, 2017

Good points. I'd honestly be surprised if nothing showed up in doctl eventually, but it may just be a matter of time and being after the beta like you say.

s3cmd looks great. It would help if I actually read the instructions so helpfully put right in my path.

Thank you.

Reply
Have another answer? Share your knowledge.

Related Questions