Error when running in dask

Hey i used to be able to run in dask but i got this error today, does anyone know what i should change?

[ERROR   ] Task exception was never retrieved

future: <Task finished name='Task-377' coro=<_wrap_awaitable() done, defined at /afs/cern.ch/user/p/piosifid/private/PocketCoffea/myenv/lib/python3.8/site-packages/distributed/deploy/spec.py:124> exception=RuntimeError('Command exited with non-zero exit code.\nExit code: 1\nCommand:\ncondor_submit -spool /tmp/piosifid/tmpgs01mb4r.sh\nstdout:\n\nstderr:\n2023/12/07 20:54:08 ERROR: Unauthorized 401 - do you have authentication tokens?\nError "/usr/bin/myschedd.sh |": command terminated with exit code 256\nConfiguration Error Line 0 while reading config source /usr/bin/myschedd.sh |\n\n')>

Traceback (most recent call last):

  File "/afs/cern.ch/user/p/piosifid/private/PocketCoffea/myenv/lib/python3.8/site-packages/distributed/deploy/spec.py", line 125, in _wrap_awaitable

    return await aw

  File "/afs/cern.ch/user/p/piosifid/private/PocketCoffea/myenv/lib/python3.8/site-packages/distributed/deploy/spec.py", line 74, in _

    await self.start()

  File "/afs/cern.ch/user/p/piosifid/private/PocketCoffea/myenv/lib/python3.8/site-packages/dask_jobqueue/core.py", line 411, in start

    out = await self._submit_job(fn)

  File "/afs/cern.ch/user/p/piosifid/private/PocketCoffea/myenv/lib/python3.8/site-packages/dask_jobqueue/core.py", line 394, in _submit_job

    return self._call(shlex.split(self.submit_command) + [script_filename])

  File "/afs/cern.ch/user/p/piosifid/private/PocketCoffea/myenv/lib/python3.8/site-packages/dask_jobqueue/core.py", line 489, in _call

    raise RuntimeError(

RuntimeError: Command exited with non-zero exit code.

Exit code: 1

Command:

condor_submit -spool /tmp/piosifid/tmpgs01mb4r.sh

stdout:



stderr:

2023/12/07 20:54:08 ERROR: Unauthorized 401 - do you have authentication tokens?

Error "/usr/bin/myschedd.sh |": command terminated with exit code 256

Configuration Error Line 0 while reading config source /usr/bin/myschedd.sh |

Hi @pol, welcome to Dask community!

At a first glance, the error does not really seem related to Dask, but more to you HPC (or alike) system using HTCondor. Are you using HTCondorCluster?

It loks like you’ve got an environment problem on your system:

Are you able to submit basic jobs?