2023-10-29 21:58:15,912 - distributed.utils_perf - WARNING - full garbage collections took 22% CPU time recently (threshold: 10%)
I am using client and persist. How to get rid of this warnning?
It probably means you’re using a lot of memory, and your worker Python processes often need to clean objects in memory.
Depending on your workflow, you can try to optimize your memory usage.
If you just want to get rid of the warning, then you’ll need to configure the logging level.
Thank you for the suggestion.
1 Like