We are running into an intermittant error when collecting futures:
client.gather(all_futures, errors="skip")
File "/var/app/venv/staging-LQM1lest/lib/python3.8/site-packages/distributed/client.py", line 2210, in gather
return self.sync(
File "/var/app/venv/staging-LQM1lest/lib/python3.8/site-packages/distributed/utils.py", line 338, in sync
return sync(
File "/var/app/venv/staging-LQM1lest/lib/python3.8/site-packages/distributed/utils.py", line 405, in sync
raise exc.with_traceback(tb)
File "/var/app/venv/staging-LQM1lest/lib/python3.8/site-packages/distributed/utils.py", line 378, in f
result = yield future
File "/var/app/venv/staging-LQM1lest/lib64/python3.8/site-packages/tornado/gen.py", line 762, in run
value = future.result()
File "/var/app/venv/staging-LQM1lest/lib/python3.8/site-packages/distributed/client.py", line 2122, in _gather
unpacked = [f for f in unpacked if f not in bad_data]
File "/var/app/venv/staging-LQM1lest/lib/python3.8/site-packages/distributed/client.py", line 2122, in <listcomp>
unpacked = [f for f in unpacked if f not in bad_data]
TypeError: unhashable type: 'list'
I think it is occuring when there is a skipped error in the calculations, but I’m not completely sure. Is this something that anyone else has encountered?