Join 1M+ other developers and:
- Get help and share knowledge in Q&A
- Subscribe to topics of interest
- Get courses & tools that help you grow as a developer or small business owner
How does horizontal scaling work and what are the limitations?
I’d like to get a better understanding of how horizontal scaling works when you’re not using a basic wsgi (or similar) setup. Does the scaling/load balancing work on any multithreaded or multiprocess applications?
And if scaled across multiple containers, can processes communicate with each other via file system/pipes/TCP/UDP?
I’m developing an api where an HTTP handler will fill a job queue. And other processes/threads will get jobs off the queue and do them. The operations require a large amount of computation on set up and so it’s not practical to do that for every request in some sort of wsgi handler.
Does anyone have any idea if the DO horizontal scaling can accommodate this? Thanks in advance.
These answers are provided by our Community. If you find them useful, show some love by clicking the heart. If you run into issues leave a comment, or add your own answer to help others.×