Additional worker deployments using `KubeCluster`

Deploying Dask
1

Hi!

Similar to the feature request in Deploying Multiple Worker Types with Helm for the dask helm chart, I was wondering whether you’re also thinking about adding the possibility to deploy additional workers (e.g. GPU nodes) with dask-kubernetes’ KubeCluster to allow for ephemeral/temporal dask cluster deployments or whether you could think of other options of achieving this?

2 Likes
2

@bstadlbauer Welcome! There’s been some work on this as a part of the Dask Operator for Kubernetes initiative, here: Overview — Dask Kubernetes 2021.03.0+100.g4a69e3a documentation. :smile:

Ref GH issue: Kubernetes Operator · Issue #256 · dask/dask-kubernetes · GitHub

1 Like