Transfer 400GB from AWS to digitalocean
Hi:
I want to know what is the fastest way to transfer 400GB from AWS ec2 to a droplet on Digitalocean.
Thanks
Sign In to Comment
1 Answer
Multiple simultaneous rsyncs, just divide up the file ranges you’re transferring, and have each rsync do a chunk.
Have another answer? Share your knowledge.
Related
-
question
PuTTY connection refused on Windows 8.1
I installed PuTTY over a year ago on Windows 7 and frequently use it to access my droplet running Ubuntu 14.04. We are preparing to ship our belongings, and I will be staying behind to complete my work contract for a few more months. So I purchased a Windows 8.1 laptop to use in the interim. All of the tools that I need are set up on it, except that I have been banging my head against the wall for a few days now trying to get PuTTY to connect to my droplet. It appears to be installed correctly, but no matter what I do, I get a connection refused error. My poor husband is having to do all of the packing amidst all of my head-banging, and I sense that his fuse is growing short, so I thought I would ask for help. Here are some of the things I've tried: * First installed PuTTY Release 0.63, then installed Release 0.64 (currently installed) * Made sure all settings on the Windows 8 setup match those on the Windows 7 machine * Generated new SSH keys and specified the Private key file for authentication under SSH Auth in PuTTY (Full disclosure: the whole SSH key stuff is somewhat fuzzy to me, but I'm leary of doing anything that might mess up the authentication that is working on my desktop since that is my only lifeline to my droplet right now.) * Telling Windows to allow PuTTY to pass through the firewall * Lots of research that turned up people saying PuTTY works just fine on Windows 8. (Note: my laptop uses an AMD processor, not Intel. Could that make a difference?) Thank you for any pointers you can offer. Bonnie
-
question
When do y'all plan on having Ubuntu 15.04?
I'm looking to launch a new site within the next couple weeks. I'm trying to decide whether I should plan on being on 15.04 or 14.04. Thanks
-
question
how can i transfer digitalocean vps files to another account?
i created a new account and droplet. i would like to transfer my old droplet to new droplet. what can i do?
-
question
Installing ERPNext in Ubuntu
I've been trying to install ERPNext in my Ubuntu Droplet, but every time I try it it send me some errors, for me it's kind of weird because if I install it in my real computer (local) It installs without problem. The errors I get are: Adding ubuntu mariadb repo Installing packages for Ubuntu. This might take time... Installing wkhtmltopdf * Stopping MariaDB database server mysqld [ OK ] * Starting MariaDB database server mysqld [ OK ] * Checking for corrupt, not cleanly closed and upgrade needing tables. Adding frappe user Installing frappe-bench Already using interpreter /usr/bin/python /home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pip/_vendor/requests/packages/urllib3/util/ssl_.py:90: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#insecureplatformwarning. InsecurePlatformWarning /home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pip/_vendor/requests/packages/urllib3/util/ssl_.py:90: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#insecureplatformwarning. InsecurePlatformWarning /home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pip/_vendor/requests/packages/urllib3/util/ssl_.py:90: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#insecureplatformwarning. InsecurePlatformWarning Cloning into 'frappe'... /home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pip/_vendor/requests/packages/urllib3/util/ssl_.py:90: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#insecureplatformwarning. InsecurePlatformWarning Exception: Traceback (most recent call last): File "/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pip/basecommand.py", line 223, in main status = self.run(options, args) File "/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pip/commands/install.py", line 291, in run wb.build(autobuilding=True) File "/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pip/wheel.py", line 705, in build self.requirement_set.prepare_files(self.finder) File "/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pip/req/req_set.py", line 317, in prepare_files functools.partial(self._prepare_file, finder)) File "/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pip/req/req_set.py", line 304, in _walk_req_to_install more_reqs = handler(req_to_install) File "/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pip/req/req_set.py", line 469, in _prepare_file session=self.session) File "/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pip/download.py", line 825, in unpack_url session, File "/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pip/download.py", line 673, in unpack_http_url from_path, content_type = _download_http_url(link, session, temp_dir) File "/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pip/download.py", line 886, in _download_http_url _download_url(resp, link, content_file) File "/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pip/download.py", line 621, in _download_url for chunk in progress_indicator(resp_read(4096), 4096): File "/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pip/download.py", line 586, in resp_read decode_content=False): File "/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pip/_vendor/requests/packages/urllib3/response.py", line 307, in stream data = self.read(amt=amt, decode_content=decode_content) File "/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pip/_vendor/requests/packages/urllib3/response.py", line 243, in read data = self._fp.read(amt) File "/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pip/_vendor/cachecontrol/filewrapper.py", line 54, in read self.__callback(self.__buf.getvalue()) File "/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pip/_vendor/cachecontrol/controller.py", line 224, in cache_response self.serializer.dumps(request, response, body=body), File "/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/pip/_vendor/cachecontrol/serialize.py", line 81, in dumps ).encode("utf8"), MemoryError installing frappe Error: None Traceback (most recent call last): File "/usr/local/bin/bench", line 9, in <module> load_entry_point('bench==0.1', 'console_scripts', 'bench')() File "/home/frappe/bench-repo/bench/cli.py", line 56, in cli bench() File "/usr/local/lib/python2.7/dist-packages/click/core.py", line 664, in __call__ return self.main(*args, **kwargs) File "/usr/local/lib/python2.7/dist-packages/click/core.py", line 644, in main rv = self.invoke(ctx) File "/usr/local/lib/python2.7/dist-packages/click/core.py", line 991, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "/usr/local/lib/python2.7/dist-packages/click/core.py", line 837, in invoke return ctx.invoke(self.callback, **ctx.params) File "/usr/local/lib/python2.7/dist-packages/click/core.py", line 464, in invoke return callback(*args, **kwargs) File "/home/frappe/bench-repo/bench/cli.py", line 161, in init no_auto_update=no_auto_update, frappe_path=frappe_path, frappe_branch=frappe_branch) File "/home/frappe/bench-repo/bench/utils.py", line 64, in init get_app('frappe', frappe_path, branch=frappe_branch, bench=path, build_asset_files=False) File "/home/frappe/bench-repo/bench/app.py", line 54, in get_app install_app(app, bench=bench) File "/home/frappe/bench-repo/bench/app.py", line 78, in install_app find_links=find_links)) File "/home/frappe/bench-repo/bench/utils.py", line 79, in exec_cmd subprocess.check_call(cmd, cwd=cwd, shell=True) File "/usr/lib/python2.7/subprocess.py", line 540, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'frappe-bench/env/bin/pip install -q -e frappe-bench/apps/frappe' returned non-zero exit status 2 Someone have an idea of what's happening ?