DO kills my python operation

Question

Hi,
I have a 2GB memory and 40GB Disk DO. I am running a python script on this and it gets killed at a particular line (I know where as it is a bit of a memory-intensive line of code). This script runs on my personal mac without a problem.

What is happening? Can I set the memory allowance of python in linux manually? I remember hearing about OOM. How can I go about this? Is this a good solution at all?
Thanks a lot.

Answer 1

gparent January 27, 2015

You can check in the kernel logs if you’re OOMing (check /var/log/kern.log or others) and the solution is to add additional memory by upgrading the droplet.

If you see messages like:

[1711385.762978] Out of memory: Kill process 21405 (apache2) score 47 or sacrifice child
[1711385.763420] Killed process 21405 (apache2) total-vm:296064kB, anon-rss:23560kB, file-rss:0kB

(but with python instead of apache), then your processes are indeed being killed because of OOMing.

If this is a one-time thing and you don’t expect to regularly use this much RAM, consider temporarily using a swap file.

Reply Report

JRun January 27, 2015

Thanks for your help, gp. What is a swap file? Is it this:
http://www.codeproject.com/Tips/785674/Creating-Linux-Swap-Files-Using-Python

Yes, I see the kill:
[1236561.813065] Out of memory: Kill process 12689 (python) score 900 or sacrifice child
[1236561.813119] Killed process 12689 (python) total-vm:2218116kB, anon-rss:1899840kB, file-rss:4kB

Can I increase or decrease the score?
Reply Report
asb January 29, 2015
@JRun Check out this tutorial on all the info about swap files and how to add one:

How To Add Swap on Ubuntu 14.04
How To Add Swap on Ubuntu 14.04
by Justin Ellingwood
Swap space can be used as an "overflow" area for your system when you run out of RAM. The operating system can store data that would normally be kept in RAM on the hard drive in a specially formatted file. In this guide, we'll demonstrate how to create and use one of these files in Ubuntu 14.04.
Reply Report

Answer 2

JRun January 27, 2015

Thanks for your help, gp. What is a swap file? Is it this:
http://www.codeproject.com/Tips/785674/Creating-Linux-Swap-Files-Using-Python

Yes, I see the kill:
[1236561.813065] Out of memory: Kill process 12689 (python) score 900 or sacrifice child
[1236561.813119] Killed process 12689 (python) total-vm:2218116kB, anon-rss:1899840kB, file-rss:4kB

Can I increase or decrease the score?
Reply Report
asb January 29, 2015
@JRun Check out this tutorial on all the info about swap files and how to add one:

How To Add Swap on Ubuntu 14.04
How To Add Swap on Ubuntu 14.04
by Justin Ellingwood
Swap space can be used as an "overflow" area for your system when you run out of RAM. The operating system can store data that would normally be kept in RAM on the hard drive in a specially formatted file. In this guide, we'll demonstrate how to create and use one of these files in Ubuntu 14.04.
Reply Report

Answer 3

JRun January 27, 2015

[deleted]

Reply Report

Question

DO kills my python operation

Leave a comment

Looking for something else?

Sign up for our newsletter

Question

DO kills my python operation

Leave a comment

Looking for something else?