Any way to group / name workers and tasks?

Distributed
3

I really appreciate you taking the time for such a good and detailed explanation, thank you.

My question is based on “deadlock” issue I encountered, which I presented in the other thread. When using LocalCluster (which works very nicely), all workers are the same (I know SpecCluster but I could not make it work with 100% CPU usage).

worker_kwargs={‘name’: ‘worker_name_prefix’}

This unfortunately gives the same prefix to all workers, so I cannot distinguish between outer and inner workers.

print(worker, data[“tasks”]) # List of tasks on this worker

I’ll go after this, which might solve my problem.

The “kwarcs” style in the documentation make it difficult to follow.

Thank you!