Question

Install Pandas in Functionless enviroment

Posted on March 31, 2023
Serverless Python Modules Python
Asked by Jeroendevr

Wanting to run a simple script using Pandas DataFrame I had a 413 error stumbling upon the 48MB restriction of the serverless function. See also a similar question here Payload too large The popular packages Pandas, Numpy are around 70 MB themselves.

I’ve been looking to reduce the size of the packages as suggested on this article How to shrink NumPy, Pandas… However setting the CFLAG to compile the package led to long deployment times.

Not being familiar with optimizing pip installs, is there a way to install/compile Pandas to get it to work within the 48 MB? Or increase the limit to 200 MB?

Show comments

Submit an answer

This textbox defaults to using Markdown to format your answer.

You can type !ref in this text area to quickly search our full set of tutorials, documentation & marketplace offerings and insert the link!

These answers are provided by our Community. If you find them useful, show some love by clicking the heart. If you run into issues leave a comment, or add your own answer to help others.

Matt Welke

DigitalOcean Employee

• May 17, 2023

Accepted Answer

We don’t recommend approaches like changing how the non-Python code in packages is compiled to try to reduce the package size, because this is difficult for us to support.

We did hear from many Functions customers that having packages like numpy and pandas included in the Python runtime would be helpful because it would let them deploy functions without exceeding the 48 MB limit. With our recently-released Python 3.11 runtime, we have included these packages as well as a few others.

Dennis Xiloj • April 4, 2023

Same problem here, did you manage to fix it?

c29d559e17c548dbb780dad712c643 • April 17, 2023

Hello, I have exactly the same issue, deploying pandas+numpy function. I also tried reducing the size with the CFLAG above, but the remote build timed out. Is there any solution?