Hi, I am working with the dask-image library and specifically the ndmeasure.label, for a geospatial analysis package I’m developing. My raster has shape 14040 x 25200 with chunksize 5120 x 5120. I am using a local distributed scheduler. The issue I have is that when I call compute/persist on the ou…

Thanks for the reply, @guillaumeeb . I believe I found the mistake I made. Instead of passing xarray.DataArray.data to the label function, I passed xarray.DataArray.values, which implicitly computes the array. I imagine the computed array is quite large when serialized, causing the warning. Beginne…

Dask-image ndmeasure.label large graph warning with few tasks

Dask Array

maxbeegee November 19, 2024, 8:30am 4

Can I ask how large your array was? I am getting some OOM error when using >~5k^3… (see Memory error using dask-image ndmeasure.label) so would be nice to have a comparison…

Topic		Replies	Views
Image Segmentation Using Large Dask Array Dask Array zarr , xarray , distributed	11	254	August 31, 2023
Debug: is it possible to associate labels or any identifier to dask tasks? Dask Array high-level-graph	1	459	June 9, 2022
Dask and nd2/tif Distributed dask-image	1	9	August 22, 2024
Specify that a given task use a huge amount of RAM to the Dask Ressource Manager Distributed distributed	5	349	October 24, 2022
Dask chunk-wise cell labeling in large-scale images Dask Array dask-image	1	108	March 14, 2024

Dask-image ndmeasure.label large graph warning with few tasks

Related topics