Hi,
I try to create dask cluster with using daskhub on the local k8s cluster. I try to use custom image for the dask-gateway but I need to know that which versions compatible with each other for dask, distributed and dask gateway ?
Hi @menendes! Dask and Dask distributed are released at the same time, so they should have the same version, the most recent is 2021.11.2. Most recent versions of Dask gateway should work, but feel free to reach back out if you have problems.
@scharlottej13 Firstly thank you for your response. I try to install daskhub via helm on the k8s cluster. When I pull the related daskhub package from dask repository, I can deploy it on the k8s cluster and I can connect the gateway. Also I can create a cluster and scale it however when I try to connect related cluster could not connect it. I got an error like " OSError: Timed out during handshake while connecting to gateway". After getting this error I search a couple days and people comments says that the reason of the error is incompatible dask and distributed package and they suggest create custom image with compatible versions for the gateway image. I also try this solution but I stuck in there because in this solution I am able to connect to cluster but I could not create a cluster. To sum up I could not run dask gateway end to end and stuck in there.
Hi @menendes, I believe this question is kind of a duplication of Could not create cluster with Dask Gateway on k8s? If so we should continue discussions there.
@guillaumeeb yes same problem and resolved. Thank you !
Just to make sure I understand: if we are pinning a version of dask-gateway, there is no requirement to pin a specific version of dask to that, right?
In other words, in our environment we are pinning, say, dask-gateway==2023.9.0, we can just leave dask unpinned to get the latest version, right?
I don’t think this is as straightforward as this. dask-gateway has been not compatible with latest Dask versions during a time. I don’t think there is any problem now. The dependency between dask-gateway and dask itself is weak, but there still is some.
So most of the time, yes, pinning dask-gateway and unpinning dask should be fine, but there might be breaking changes at some point which would need upgrading dask-gateway.
Fascinating. Okay thanks @guillaumeeb! How would we know when we need to pin dask?
Well, I don’t know. Maybe it’s worth asking the question on dask-gateway GitHub issue tracker.