Can I submit tasks and exit the local client?

Distributed
1

I’m using Dask with Fargate to do some data processing, and I was wondering if it’s possible to send all the tasks to the scheduler and exit my local client.

My tasks usually write the results into S3 and the client doesn’t collect any results in memory, so there is no need for the client to be hanging around.

2

You want “fire and forget”: API — Dask.distributed 2022.8.1 documentation

2 Likes