Related

Product Managed Kubernetes on DigitalOcean Product
Is there plans to support Anycast DNS Question Question
Best choice for 5k request spikes Question Question

Question

Managed Kubernetes: Load balancer says all nodes are down

Posted May 28, 2020 189 views
Load BalancingHigh AvailabilityKubernetesDigitalOcean Managed KubernetesDigitalOcean Managed Load Balancers

All the pods seem to be running as normal, and can be reached using kubectl.

All of a sudden (without anyone touching anything), the load balancer is no longer working.

It is not possible to reach the website externally. The internal dns in Kubernetes seems to work as usual however. (When I test by exec-ing into one of the pods)

Does anyone know what might have happened here?

Add a comment
tobiasbergkvist
By:
tobiasbergkvist
Add a comment
1 comment
  • conradwt May 30, 2020
    Reply Report

    Hi tobiasbergkvist, I would recommend using tools like Prometheus and Grafana to see what’s happening within your cluster. Here’s a good work through for getting these tools installed within your Kubernetes cluster using Helm. Well, all the best and please have a great weekend.

    –

    Think different and code well,

    -Conrad

These answers are provided by our Community. If you find them useful, show some love by clicking the heart. If you run into issues leave a comment, or add your own answer to help others.

×
1 answer
tobiasbergkvist May 28, 2020

Seems like this was caused by memory usage being too high! I had added ELK for logging a couple of weeks ago, and it had slowly been eating up all the memory.

Somehow this must have killed something critical to external DNS (without actually killing the website pods).

Reply Report
Submit an Answer

Related

Looking for something else?

Ask a new question Search for more help