Polars is a DataFrame library designed for high performance in data wrangling. It has a multi-threaded query engine written in Rust, allowing for effective parallelism. The library’s vectorized and columnar processing enables cache-coherent algorithms and high performance on modern processors. Polars is easy to use, with intuitive expressions that empower users to write readable and performant code. It is open source and encourages community contributions. Polars outperforms other solutions, achieving more than 30x performance gains compared to pandas. It supports a wide range of data formats and integrates well with existing data tools. Polars is written in Rust, offering fine-grained control over memory. It also provides an out-of-core streaming API for processing large datasets efficiently.
https://pola.rs/