By Jeroendevr
Wanting to run a simple script using Pandas DataFrame I had a 413 error stumbling upon the 48MB restriction of the serverless function. See also a similar question here Payload too large The popular packages Pandas, Numpy are around 70 MB themselves.
I’ve been looking to reduce the size of the packages as suggested on this article How to shrink NumPy, Pandas… However setting the CFLAG to compile the package led to long deployment times.
Not being familiar with optimizing pip installs, is there a way to install/compile Pandas to get it to work within the 48 MB? Or increase the limit to 200 MB?
This textbox defaults to using Markdown to format your answer.
You can type !ref in this text area to quickly search our full set of tutorials, documentation & marketplace offerings and insert the link!
Accepted Answer
We don’t recommend approaches like changing how the non-Python code in packages is compiled to try to reduce the package size, because this is difficult for us to support.
We did hear from many Functions customers that having packages like numpy
and pandas
included in the Python runtime would be helpful because it would let them deploy functions without exceeding the 48 MB limit. With our recently-released Python 3.11 runtime, we have included these packages as well as a few others.
Hello, I have exactly the same issue, deploying pandas+numpy function. I also tried reducing the size with the CFLAG above, but the remote build timed out. Is there any solution?
Get paid to write technical tutorials and select a tech-focused charity to receive a matching donation.
Full documentation for every DigitalOcean product.
The Wave has everything you need to know about building a business, from raising funding to marketing your product.
Stay up to date by signing up for DigitalOcean’s Infrastructure as a Newsletter.
New accounts only. By submitting your email you agree to our Privacy Policy
Scale up as you grow — whether you're running one virtual machine or ten thousand.
Sign up and get $200 in credit for your first 60 days with DigitalOcean.*
*This promotional offer applies to new accounts only.