Question

Is there/will there be an object storage CLI for DO Spaces?

Posted September 18, 2017 3.1k views
Storage

I’ve attempted poking around with doctl to see if there is any support for using it as a CLI for the new object storage DO has in beta, but I’m not seeing anything that seem related to this. Documentation doesn’t reflect anything yet available, either. I’m using the version compiled by homebrew for MacOS.

I also considered the AWS cli, and while the APIs supposedly are compatible as per docs, the aws CLI internally assumes some things about URLs and regions specific to AWS that make it impossible.

Will there be an update to doctl to allow for CLI access to object storage?

Does anyone know of a compatible CLI tool that could be used in the meantime?

Add a comment
weildish
By:
weildish
Add a comment

These answers are provided by our Community. If you find them useful, show some love by clicking the heart. If you run into issues leave a comment, or add your own answer to help others.

3 answers
xMudrii September 18, 2017

Until Spaces don’t reach General Availability point, I don’t believe we’ll see any official CLI. Well, as it’s private beta, it’s sort of “hidden” from public and sharing information about Spaces is not that advised.

However, this sounds like a great idea and I would love to see sort of official support in doctl.
Maybe creating an issue on GitHub would be a good idea. As always, I would love to help and work on it, but I wouldn’t start anything before we get green light on it.

In meanwhile.. s3cmd could be useful. When you create a new Space, you will have welcome.html file in the root. There will be links to the docs which could be useful to you. It even covers s3cmd.

Reply Report
shua November 7, 2018

The issue with s3cmd is that it does not support parrellel out of the box.
I used the below command. However, DO if you read this please realize ppl like myself transferring 20T of data will need to wait days for all the data to transfer

find . -type f | sed 's|^./||g' | xargs -P 8 -I {} s3cmd put {} s3:///{}
Reply Report
weildish September 19, 2017

Good points. I’d honestly be surprised if nothing showed up in doctl eventually, but it may just be a matter of time and being after the beta like you say.

s3cmd looks great. It would help if I actually read the instructions so helpfully put right in my path.

Thank you.

Reply Report
Submit an Answer

Related

Looking for something else?

Ask a new question Search for more help