Load Balancer Drupal Configure for Beginner

Is it worth using GlusterFS instead of lsyncd? Best way to keep files synced if I need to add more application nodes?

With just two nodes lsyncd might be a better option as it would provide quicker access to files since everything will be stored locally. GlusterFS may make things easier once you have 3 or more nodes and would also allow you to make more efficient use of your available space across nodes.

I may just run one application node, and boot up the second from a snapshot during peak volume times, thoughts on this approach?

This approach would work but you would need to configure a method to increase space that will both spin up the new node from a snapshot and update nginx so that traffic is routed to it (or if using the DO load balancer service you could do this via the API).

The node attachments (99.9%) images can take up a lot of space, I’m thinking use S3 to host these files (the domain name isn’t that important for these). This would allow me to not worry about replicating files on both application nodes or worry about running out of storage on a small sized node. Any thoughts on this approach? I would have considered DO’s block storage, but it looks like it can only connect to one node at a time. How about a specific application node dedicated to file storage instead of S3?

Using object storage like S3 or DigitalOcean Spaces would be a viable solution here that should reduce the requirements on your nodes and would not need to set up some type of live redundancy of your files since you would reference the object storage directly.