Report this

What is the reason for this report?

Can't list all keys on Spaces: no continuation token

Posted on April 30, 2018

Hey guys.

I’m using Digital Ocean spaces to store the files the users upload. I currently have around 6 million. I’m using Node JS and AWS-SDK to manage all these files, and right now I want to get the list of keys of all these files. However, when I try S3.listObjectV2, it doesn’t return any continuation token or anything so that I’m stuck with the first 1000 files. Looking forward to your reply.



This textbox defaults to using Markdown to format your answer.

You can type !ref in this text area to quickly search our full set of tutorials, documentation & marketplace offerings and insert the link!

These answers are provided by our Community. If you find them useful, show some love by clicking the heart. If you run into issues leave a comment, or add your own answer to help others.
0

Accepted Answer

Hello. Sorry for the trouble. We’ve noted here in the API documentation that the version 2 type list is not currently supported by the Spaces API.

If you use listObjects instead of listObjectsV2 you should see a result which includes the continuation token.

Be sure to check the documentation how the token is named!

AWS S3: ContinuationToken and NextContinuationToken DigitalOcean Spaces: Marker and NextMarker

The developer cloud

Scale up as you grow — whether you're running one virtual machine or ten thousand.

Get started for free

Sign up and get $200 in credit for your first 60 days with DigitalOcean.*

*This promotional offer applies to new accounts only.