Hi, I am working with the dask-image library and specifically the ndmeasure.label, for a geospatial analysis package I’m developing. My raster has shape 14040 x 25200 with chunksize 5120 x 5120. I am using a local distributed scheduler. The issue I have is that when I call compute/persist on the ou…

Thanks for the reply, @guillaumeeb . I believe I found the mistake I made. Instead of passing xarray.DataArray.data to the label function, I passed xarray.DataArray.values, which implicitly computes the array. I imagine the computed array is quite large when serialized, causing the warning. Beginne…

Hi @martijnvandermarel , welcome to Dask community! This message comes usually when you crete object on the client side, and then serialize them through the tasks graph. Could you give us a reproducer, or at least some code snippet of what you are doing? How do you read your input data?

Dask-image ndmeasure.label large graph warning with few tasks

Dask Array

maxbeegee November 19, 2024, 8:30am 4

Can I ask how large your array was? I am getting some OOM error when using >~5k^3… (see Memory error using dask-image ndmeasure.label) so would be nice to have a comparison…

Topic		Replies	Views
Memory error using dask-image ndmeasure.label Dask Array dask-image	4	85	November 22, 2024
Error while using ndmeasure.area : Cannot block reusing for graphs Dask Array dask-image	0	19	February 11, 2026
Image Segmentation Using Large Dask Array Dask Array zarr , xarray , distributed	11	337	August 31, 2023
Latency between graph constitution and start of calculation Distributed performance	4	368	January 18, 2023
Dask chunk-wise cell labeling in large-scale images Dask Array dask-image	1	182	March 14, 2024

Dask-image ndmeasure.label large graph warning with few tasks

Related topics