Report this

What is the reason for this report?

Cross Region High Availability

Posted on April 26, 2020

Hello

On 04/22/20 there was a multi region outage with Digital ocean where NYC,SF and LO all had outages.

Since then I’ve been looking into how to setup multi region high availability and am not sure it can be done currently with Digital Ocean.

It seems like Load Balancers are locked to droplets in a single data center and Managed Databases servers are also locked to the same data center, even the backup standby nodes.

So my question is how do you setup your infrastructure in DigitalOcean so that you have redundancy setup across multiple regions?

Thanks!



This textbox defaults to using Markdown to format your answer.

You can type !ref in this text area to quickly search our full set of tutorials, documentation & marketplace offerings and insert the link!

These answers are provided by our Community. If you find them useful, show some love by clicking the heart. If you run into issues leave a comment, or add your own answer to help others.

Adding a reply to comment and follow this topic. I noticed that problem and from what I remember, pretty much all DO datacenters in the USA and some in Europe suffered from that outage at various degrees.

I took away from it that DO seems to be very reliant on a backbone bandwidth provider, and an outage at that provider took all these places down or at least created a whole lot of troubles – for what seemed to be a good part of the day, and became “all green” only the day after (that I saw).

@mindglitch , you might want to look at using DNS failover (or load-balancing). Many DNS providers (Route53, DNSME etc) do provide that functionality across regions or even providers.

Cloudflare or Fastly can do this at the HTTP-Proxy level, so you could add more intelligence than just a “healthcheck”.

As far as DO is concerned, they need to convince users that such an event “cannot” happen if you pick any two or even three DO datacenters. Unfortunately, that 4-22 event showed that it did happen.

As a customer, the only solution is to be ready to go with another provider. Myself, I use Linode as a no-DO failover (ongoing replication), but it would be more convenient to stay within DO, I agree.

This is the holy grail. Cloud providers should just provide this as a package. Master-master with global LB that routes between regions using a priority attribute on each region.

Hi there,

A quick update here, DigitalOcean has announced new Global Load Balancers (currently in beta) which will allow you to distribute traffic to Droplets in different regions for high availability (HA) and performance.

Whereas regional load balancers distribute traffic within a single region, global load balancers span multiple regions and route users to your nearest available backend Droplet.

For more information you can check out this documentaiton here:

https://docs.digitalocean.com/products/networking/load-balancers/how-to/create-global-load-balancer/

Or check out this introduction video here:

- Bobby

The developer cloud

Scale up as you grow — whether you're running one virtual machine or ten thousand.

Get started for free

Sign up and get $200 in credit for your first 60 days with DigitalOcean.*

*This promotional offer applies to new accounts only.