Summary
Dask has added support for monitoring Python’s Global Interpreter Lock (GIL) in dask.distributed version 2023.4.1.
Code running on Dask runs in a threaded environment with other threads doing compression, disk I/O, network I/O, and other user code. Hopefully this code uses the GIL judiciously, but making workflows more GIL-friendly can improve performance.
GIL monitoring through the dashboard and Prometheus metrics enables users to identify workflows that can be improved to be more GIL friendly.