Let pods terminate gracefully on soft eviction thresholds

Right now any evicted pods get terminated with 0 seconds grace period even when a soft eviction threshold is breached, which I think is wrong and effectively ignores the terminationGracePeriodSeconds set on the pod’s spec in eviction scenarios.

We need to configure the eviction policies https://kubernetes.io/docs/tasks/administer-cluster/out-of-resource/ and change the --eviction-max-pod-grace-period=“0” setting so that pods have a chance to gracefully shutdown when they are evicted.

It looks as though the dynamic kubelet config option is disabled by default on DOKS, (–dynamic-config-dir kubelet flag is not being set to a writable directory). Would it be possible to enable this so that we can configure the kubelet dynamically? (https://kubernetes.io/docs/tasks/administer-cluster/reconfigure-kubelet/#reconfiguring-the-kubelet-on-a-live-node-in-your-cluster)