I’m using Dask with Fargate to do some data processing, and I was wondering if it’s possible to send all the tasks to the scheduler and exit my local client. My tasks usually write the results into S3 and the client doesn’t collect any results in memory, so there is no need for the client to be han…

Can I submit tasks and exit the local client?

martindurant April 9, 2022, 1:37am 2

2 Likes

Topic		Replies	Views
Understanding Client.submit and fire_and_forget Distributed	2	525	March 10, 2023
Advice on how to structure Dask computation Distributed	7	53	January 16, 2025
Tasks forgotten waiting for new workers to be allocated Distributed dask-jobqueue , distributed	8	92	June 6, 2025
Common workflow for using Dask on HPC systems Distributed distributed	2	91	October 18, 2024
Submit demo and not work Distributed distributed	3	152	March 2, 2023