If you primarily are connecting to machines to fix configs and the like, then definitely get to know vim.
That said, as you scale out things, you hopefully won’t be doing as much ssh'ing to machines to edit files and instead will be editing some configuration management system like chef, ansible, etc. In this case it is good to spend time with a programmers editor, which could be vim as well! Emacs is another great choice as it has tons of helpful features for working with many different languages, taking notes, and interacting with other systems (ie TRAMP).
I’ll admit I jumped on the Emacs train long ago and happily recommend it to folks, but vim is great too. In vim, I think you typically end up using other tools like tmux, fzf, etc. increase productivity where as in Emacs, you end up using different plugins. Choose what makes sense to you!