Summary
Dask has added support for monitoring Python’s Global Interpreter Lock (GIL) in dask.distributed version 2023.4.1.
Code running on Dask runs in a threaded environment with other threads doing compression, disk I/O, network I/O, and other user code. Hopefully this code uses the GIL judiciously, but making workflows more GIL-friendly can improve performance.
GIL monitoring through the dashboard and Prometheus metrics enables users to identify workflows that can be improved to be more GIL friendly.
Link to post
https://medium.com/coiled-hq/gil-monitoring-in-dask-eebc2013498f