I need to have one or more long running processes that capture a streamers chat data and store it to a local file (ie each chat message will be a single line written to streamer-name.txt).
Every 12 hours, I will grab all streamer files, process them, and move to another service. So the files need to persist!
I have no idea how to accomplish this… I was considering utilizing an S3 bucket and writing to that but I have concerns about latency and reliability… maybe this shouldn’t be a concern? Maybe a virtual machine or something?
These answers are provided by our Community. If you find them useful, show some love by clicking the heart. If you run into issues leave a comment, or add your own answer to help others.