Is there a way to install large pip packages on basic droplet instances. There seems like some process which anneals the network bandwith after 700mbs and evantually kills pip - preventing the package from installing. Note process id 17918 was the pip process.
For example:
python -m pip install torch
Here is the shell log of the above command failing:
(tinygrad) root@transformer-cpu ~/tinygrad # â¯â¯â¯ python -m pip install torch â 1 master
Collecting torch
Downloading torch-1.7.1-cp38-cp38-manylinux1_x86_64.whl (776.8 MB)
|ââââââââââââââââââââââââââââââââ| 773.3 MB 73 kB/s eta 0:00:48
|ââââââââââââââââââââââââââââââââ| 776.0 MB 7.3 kB/s eta 0:01:47[1] 17918 killed python -m pip install torch
This textbox defaults to using Markdown to format your answer.
You can type !ref in this text area to quickly search our full set of tutorials, documentation & marketplace offerings and insert the link!
Accepted Answer
Hi there @iainondigitalocean,
It sounds like that you are running out of RAM, what you could do is to add a SWAP file so that you could have some extra buffer:
https://www.digitalocean.com/community/tutorials/how-to-add-swap-space-on-ubuntu-20-04
Another thing that I’ve seen people reporting as working is to add the --no-cache-dir to your pip install command.
Let me know how it goes. Regards, Bobby
Become a contributor for community
Get paid to write technical tutorials and select a tech-focused charity to receive a matching donation.
DigitalOcean Documentation
Full documentation for every DigitalOcean product.
Resources for startups and SMBs
The Wave has everything you need to know about building a business, from raising funding to marketing your product.
The developer cloud
Scale up as you grow — whether you're running one virtual machine or ten thousand.
Get started for free
Sign up and get $200 in credit for your first 60 days with DigitalOcean.*
*This promotional offer applies to new accounts only.