aws lamdab size limit

[Charonnnnn]

Didn't you encounter aws lamdab size limit error?

Unzipped size must be smaller than 262144000bytes (Service:AWSLambdaInternal; Status Code: 400; Error Code: InvalidParameterValueException; Request ID: 76e24f8b-8e0c-40d1-88a8-dff681e00c52)

The pytorch lib(1.3gb, after zip still has 800mb) is too big for lambda to handle, how did you solve the problem?

[Charonnnnn]

The tmp folder is only got 500mb which is not enough either. Even it works, it must be full and gonna display 'No space left on device' error when running function

[mpaepper]

Hi @Charonnnnn

I managed to get it under 500MB back then and used the tmp extraction trick in the lambda layer.
Check out these useful threads for some more details (might be a bit outdated with the newest PyTorch versions):

pytorch/pytorch#15213

Here is a docker build: https://github.com/Con-Mi/data_science_aws_lambda_packs/tree/master/pytorch1.0.1 which you can strip down further (see image extracted from that Github thread)