Best method for uploading large (9GB) file?
I'm trying to upload a large file, 9.5GB, to my droplet. It's in a directory with many other files that I need on the droplet, so I tried rsync:
rsync -az --progress grassdata/trichastll firstname.lastname@example.org:grassdata/
This appeared to work, but the pipe is broken after a while - 30 minutes to an hour, when the upload will take ca. 4 hours to complete. Restarting rsync did not restart with the partially uploaded file, but instead started to reload this particular large file completely.
Now I'm trying sftp, with compressionLevel=9 and TCPKeepAlive=yes. So far so good, but it will take another 3 hours to complete, assuming it works (after which I'll return to rsync to get the rest of my smaller files on board). In the meantime, I wonder if there is another option for uploading large files reliably that I should use instead?
specs: Debian 7/64bit on 32GB RAM server
EDIT: just found out about rsync --partial. I'll try that next time for sure. Still interested in alternatives!