Lots of Warnings while launching a cluster

1

Is it alright to see so many warnings during a normal launching scenario?
That’s kind of annoying.

In [7]: from dask.distributed import Client, progress, LocalCluster
   ...:
   ...: cluster = LocalCluster(dashboard_address='127.0.0.1:8787',
   ...:                        worker_dashboard_address='127.0.0.1:8787',
   ...:                        n_workers=8,
   ...:                        threads_per_worker=1,
   ...:                        memory_limit='400MiB')
   ...: client = Client(cluster)

/home/vol/.local/lib/python3.8/site-packages/distributed/node.py:182: UserWarning: Port 8787 is already in use.
Perhaps you already have a cluster running?
Hosting the HTTP server on port 34375 instead
  warnings.warn(
/home/vol/.local/lib/python3.8/site-packages/distributed/node.py:182: UserWarning: Port 8787 is already in use.
Perhaps you already have a cluster running?
Hosting the HTTP server on port 43001 instead
  warnings.warn(
/home/vol/.local/lib/python3.8/site-packages/distributed/node.py:182: UserWarning: Port 8787 is already in use.
Perhaps you already have a cluster running?
Hosting the HTTP server on port 46245 instead
  warnings.warn(
/home/vol/.local/lib/python3.8/site-packages/distributed/node.py:182: UserWarning: Port 8787 is already in use.
Perhaps you already have a cluster running?
Hosting the HTTP server on port 41197 instead
  warnings.warn(
/home/vol/.local/lib/python3.8/site-packages/distributed/node.py:182: UserWarning: Port 8787 is already in use.
Perhaps you already have a cluster running?
Hosting the HTTP server on port 36131 instead
  warnings.warn(
/home/vol/.local/lib/python3.8/site-packages/distributed/node.py:182: UserWarning: Port 8787 is already in use.
Perhaps you already have a cluster running?
Hosting the HTTP server on port 36221 instead
  warnings.warn(
/home/vol/.local/lib/python3.8/site-packages/distributed/node.py:182: UserWarning: Port 8787 is already in use.
Perhaps you already have a cluster running?
Hosting the HTTP server on port 39607 instead
  warnings.warn(
/home/vol/.local/lib/python3.8/site-packages/distributed/node.py:182: UserWarning: Port 8787 is already in use.
Perhaps you already have a cluster running?
Hosting the HTTP server on port 35521 instead
  warnings.warn(
2

Hi @kvdm.dev,

It’s normal considering your code: you’re trying to launch 8 local workers with the same port as the scheduler, so 8 warnings.

3

Ummmm, but i launch a cluster, not workers particularly, that’s a conceptual difference.

So how i should run a cluster with multiple workers to avoid warnings?

4

You probably mean this parameter worker_dashboard_address='127.0.0.1:8787',. I added it without understanding what it is for at the very beginning, because by default the addresses assigned to workers are public 0.0.0.0.

In such the case i should remove the parameter and somehow disable the 0.0.0.0 default worker dashboard address.

5

Yes, that’s it. Did you try with worker_dashboard_address='127.0.0.1:0' ?

6

It works, thank you. I’ve never seen the zero-port notation .

1 Like