I need to zip a set of files from a folder in bucket and download it for the User

October 18, 2017 5k views
Node.js
infoc8fa8380fc94a1aac6aa70
By:
infoc8fa8380fc94a1aac6aa70

I am uploading files in various folders in the bucket "managly".
I need to implement a functionality to zip a set of files (as selected by the User) from a folder in bucket and download the zip file for the User.
I tried using "aws-s3-zipper" in Node.js to filter the files from the bucket's folder and then zip it and download.
I get the following error - InvalidAccessKeyId: The AWS Access Key Id you provided does not exist in our records.
Kindly guide me and provide me the code in NodeJS to implement the same.

Code :-

var S3Zipper = require ('aws-s3-zipper');

var config ={
      accessKeyId: ACCESS_KEY_ID,
      secretAccessKey: SECRET_ACCESS_KEY,
      bucket: BUCKET
};

var zipper = new S3Zipper(config);

zipper.filterOutFiles = files; //files is the set of files selected by User

zipper.streamZipDataTo({
            pipe: res,
            folderName: 'attachments',
            startKey: 'null', // could keep null
            recursive: true
          }
          , function (err, result) {
            if (err)
              console.log(err);
            else {
              // console.log(result);
              var lastFile = result.zippedFiles[result.zippedFiles.length - 1];
              console.log('lastFile : ', lastFile)
              if (lastFile)
                console.log('last key ', lastFile.Key); // next time start from here
            }
          });
1 comment
Log In to Comment
2 Answers
asb MOD February 26, 2018

DigitalOcean Spaces was designed to be interoperable with the S3 API in order to allow users to take advantage of existing tooling. In most cases, setting the endpoint to the DigitalOcean region (e.g. nyc3.digitaloceanspaces.com) will allow Spaces to be a drop-in replacement. Though, in order to do this, the tool must allow configuring that option. Unfortunately, aws-s3-zipper does not expose that yet. I've submitted a pull request to add support.

Once it lands, you will be able to configure aws-s3-zipper to use Spaces like so:

var config = {
    endpoint: "nyc3.digitaloceanspaces.com",
    region: "nyc3",
    accessKeyId: "MY_SPACES_KEY",
    secretAccessKey: "MY_SPACES_SECRET",
    bucket: 'examplebucket'
};

var zipper = new S3Zipper(config);
Reply
aklearn October 1, 2018

Is there an update on this? I'm trying to do this with Laravel (PHP framework). There are a set of files which I need to zip and give to the user at run time. So, the user uploads a bunch of files and another user shows up to download them. I need to zip and set the download.

Please let me know.

Reply
Have another answer? Share your knowledge.

Related Questions