Hi, I have a set of unit tests which internally create and tear down local clusters: def test_one(): with LocalCluster() as cluster: # do something def test_two(): with LocalCluster() as cluster: # do something when running these tests sequentially, all tests pass. When running them …

@PGijsbers I’m not able to reproduce the ResourceWarning. Could you please share some details about your machine and environment? I tried functions with sleep() to simulate work: def test_one(): with LocalCluster() as cluster: sleep(5) def test_two(): with LocalCluster() as clust…

I came up with this, which seems to work. The idea is acquire file lock. if this blocks, it’ll do so until whatever worker currently executes step 2 is done and then we’ll succeed in acquiring it. try to read the address file. if we’re the first worker trying to do that, we won’t find it. in tha…

Using Pytest with LocalClusters

Distributed

PGijsbers August 26, 2022, 2:14pm 2

I managed to make with work with a shared fixture, but for some scenarios I want to configure the LocalCluster differently. Making a fixture for each test works, but seems bad practice.

Topic		Replies	Views
Can't connect to local cluster - times out Distributed	5	2921	December 11, 2021
Multiple local clusters on the same (virtual) machine: PermissionError Distributed	4	241	September 28, 2022
Lots of Warnings while launching a cluster	5	1466	March 28, 2023
Initiating a LocalCluser leads to CERT_TRUST_IS_UNTRUSTED_ROOT error on data load Distributed	8	145	May 31, 2024
LocalCluster + MPI calls MPI_Init_Thread twice? Distributed distributed	6	551	May 10, 2023

Using Pytest with LocalClusters

Related topics