Cannot reach my service after 1 terraform apply

I have set up a k8s cluster using terraform, helm, cert-manager, and traefik as ingress controller.

If I perform terraform apply from scratch, all the components start correctly, and I can reach my test web page that uses a valid SSL certificate. Getting to this point took me the better part of past week…

So I finally thought I had figured it out, but I noticed that if I make some changes to the terraform config (for example add a new unrelated k8s deployment) and perform terraform apply again, I can no longer reach my test web page and instead I get curl: (35) OpenSSL SSL_connect: Connection reset by peer in connection to mydomain.com:443.

There are no errors in any of the pod logs so I suspect the problem lies somewhere between my Digital Ocean load balancer and my cluster.

An important thing is that I use the service.annotations.kubernetes.digitalocean.com/load-balancer-id-annotation on the traefik deployment so when I start the traefik ingress controller it reuses an existing Digital Ocean load balancer (which I also created with Terraform).

I have no idea where to start debugging since it works correctly after destroying all resources and performing terraform apply for the first time.

Please Help!