Can't connect between droplets using public IP
I'm randomly having problems connecting between droplets via the public IP. I can connect to all droplets from my local machine (ping, SSH, etc) but between SOME droplets I cannot connect when using the public IP. Private IP seems unaffected:
[root@docker-2 ~]# ping 126.96.36.199 PING 188.8.131.52 (184.108.40.206) 56(84) bytes of data. From 220.127.116.11 icmp_seq=1 Destination Host Unreachable
(18.104.22.168 is the public IP for another node, which I can ping and SSH to from my local machine directly using this IP)
But I can ping the same machine using it's private IP:
[root@docker-2 ~]# ping 10.130.73.188 PING 10.130.73.188 (10.130.73.188) 56(84) bytes of data. 64 bytes from 10.130.73.188: icmp_seq=1 ttl=64 time=1.72 ms
(10.130.73.188 is the private IP of 22.214.171.124)
This droplet is able to ping other servers over the internet, e.g.
[root@docker-2 ~]# ping 126.96.36.199 PING 188.8.131.52 (184.108.40.206) 56(84) bytes of data. 64 bytes from 220.127.116.11: icmp_seq=1 ttl=60 time=0.922 ms
There are no DO firewalls applied to any servers. All servers are Centos 7 with no firewalld and no custom networking rules applied, aside from those set up by Docker.
This seems to be random, since if I kill the droplet and reconfigure it, it sometimes starts to work. All droplets are configured by ansible and should be identical, yet some exhibit this problem and some do not.
Here's a tracepath result from the same droplet, showing first another droplet I can't reach and 2nd a droplet that I can reach. All 3 are in the same datacenter and all configured identically:
[root@docker-2 ~]# tracepath 18.104.22.168 1?: [LOCALHOST] pmtu 1500 1: 22.214.171.124 5.782ms 1: 126.96.36.199 8.442ms 2: 188.8.131.52 0.553ms 3: no reply 4: no reply 5: no reply
[root@docker-2 ~]# tracepath 184.108.40.206 1?: [LOCALHOST] pmtu 1500 1: 220.127.116.11 17.165ms 1: 18.104.22.168 3.751ms 2: 22.214.171.124 0.519ms 3: 126.96.36.199 0.432ms 4: 188.8.131.52 0.835ms reached Resume: pmtu 1500 hops 4 back 4
Please help. I'm new to DO and surprised how long it takes to get a support ticket answered so I'm trying here.