Closing Nanny in aws Lambda while creating Client(n_workers=4)

I want to craate Dask.Client in an aws lambda but im getting Closing Nanny at ‘tcp://’. Reason: nanny-instantiate-failed on dask distributed.

i am using a docker image to create the lambda .

Hi @lalit, welcome to Dask community!

Do you have some more detail stack trace or log of the error?

I’m not sure what you can do using AWS Lambda, as it is made for small tasks, maybe sub process spawning is limited somehow?