Dividing data among workers and downloading data local to a worker

Hi @vigneshn1997! Would you be able to provide a copy paste-able minimal reproducer? It’d be helpful to know what you’ve tried and how it works currently, rather than us writing up a minimal example that only guesses at what you’re doing. Additionally, this question sounds similar to other questions you’ve asked (e.g. Dask data sharding and Shuffle and shard dask dataframe), perhaps the replies shared there could help you here?