Hi, everyone, hope you all are fine!
I’m doing de following code:
status_df.compute().to_csv("status.csv", index=False)
And sometimes it works perfectly, but often, this error occurs:
RuntimeError: shuffle_barrier failed during shuffle 462c1919b85b0d439604c94c1bbc82da
I’ve made a research and it seems that P2P solve this problem, but I’m still not sure it does and why this error is happening sometimes. Can someone help me? Someone else has faced this issue?
Thank you!
Hi @kamiruseler, welcome to Dask community,
Would you be able to provide a minimal reproducer?
It’s hard to tell with just this error if it comes from your data, your computation, or Dask. There are also several issues opened and closed about this subject on github.