Question
node.js with one or more long running processes that need to write to file system
- Posted on April 28, 2022
- Node.jsStorage
Asked by TinyCeruleanCrab
I need to have one or more long running processes that capture a streamers chat data and store it to a local file (ie each chat message will be a single line written to streamer-name.txt).
Every 12 hours, I will grab all streamer files, process them, and move to another service. So the files need to persist!
I have no idea how to accomplish this… I was considering utilizing an S3 bucket and writing to that but I have concerns about latency and reliability… maybe this shouldn’t be a concern? Maybe a virtual machine or something?
This textbox defaults to using Markdown to format your answer.
You can type !ref in this text area to quickly search our full set of tutorials, documentation & marketplace offerings and insert the link!
These answers are provided by our Community. If you find them useful, show some love by clicking the heart. If you run into issues leave a comment, or add your own answer to help others.
Want to learn more? Join the DigitalOcean Community!
Join our DigitalOcean community of over a million developers for free! Get help and share knowledge in Q&A, subscribe to topics of interest, and get courses and tools that will help you grow as a developer and scale your project or business.
Hello,
Indeed using a Droplet sounds better than the App Platform, as with the Droplet you will have persistent storage.
You can follow the steps here on how to deploy a Node.js App on a Droplet:
The commands from the video can be found here:
https://www.digitalocean.com/community/tutorials/how-to-set-up-a-node-js-application-for-production-on-ubuntu-16-04
Hope that this helps!
Best,
Bobby