Hi there!
I have a question regarding the asynchronous usage of the new operator.KubeCluster class.
This class is not a subclass of distributed.deploy.SpecCluster anymore so the cluster is not started automatically when we instantiate it and set the asynchronous arg to True.
I am trying to figure out the best way to handle asynchronous cluster start since I would like to use the new implementation with prefect (see this issue).
Right now, I am calling the private _start method but wonder what is the good practice with an asynchronous instance? (didn’t find anything in the doc regarding asynchronous operator.KubeCluster). Also, I am curious why this new class does not use the distributed.deploy.SpecCluster anymore?
Thanks!