GIL monitoring in Dask


Dask has added support for monitoring Python’s Global Interpreter Lock (GIL) in dask.distributed version 2023.4.1.

Code running on Dask runs in a threaded environment with other threads doing compression, disk I/O, network I/O, and other user code. Hopefully this code uses the GIL judiciously, but making workflows more GIL-friendly can improve performance.

GIL monitoring through the dashboard and Prometheus metrics enables users to identify workflows that can be improved to be more GIL friendly.

Link to post