High Level Query Optimization in Dask

Summary

Dask DataFrame users can now try out Dask expressions, a new effort in logical query planning. Though still under development, we’re already seeing performance gains.

The library includes features like pushing column selections and filters down or optimizing length computations. Dask expressions is still in development, but it covers much of the DataFrame API. Interested users are welcome to try it out and give feedback!

Link

2 Likes