DA

ddotta/awesome-polars

开发工具
1127 stars 质量 35 趋势 60

A curated list of Polars talks, tools, examples & articles. Contributions welcome !

概览

A curated list of Polars docs, talks, tools, examples & articles the internet has to offer. Polars is a lightning-fast DataFrame library for Rust, Python, Node.js and R. Implemented in Rust, Polars uses Apache Arrow Columnar Format as the memory model. - Filling a suggestion issue. - Opening a pull request. To see the latest entries in the list, view the changelog on trackawesomelist.com. - : Polars raises €18M Series A to build fast, ergonomic data processing at any scale. - : Polars launches Polars Cloud and a Distributed Engine in Open Beta. - : Polars announces that it has raised a a $4M seed round! - : Python Polars 1.0 release ! See this blog post special announcement. - : Polars has a new lightweight plotting backend. - : GPU acceleration with Polars and NVIDIA RAPIDS. - : Polars Cloud; the distributed Cloud Architecture to run Polars anywhere. - Documentation - Official user guide for Python, Rust and R. - Documentation for Python API - Official API Reference for Python.

README


Awesome Polars

Official news

Official documentation

Libraries/Packages/Scripts

Polars plugins

To learn to write, see this great tutorial by @MarcoGorelli!

You can also try to Polars plugins Cookiecutter by @MarcoGorelli which provides a template to quickly scaffold a Rust-based plugin for the Polars Python library.

Import / Export

Data Manipulation

  • tidypolars tidypolars python library built on top of polars library that gives access to methods and functions familiar to R tidyverse users.
  • Ibis Python package for Polars - Ibis is a Python library that provides a lightweight, universal interface for data wrangling. It can be used with Polars.
  • pyjanitor - Python package that provides a clean API for cleaning Polars DataFrame @pyjanitor-devs.
  • catfact - Python package for working with categorical data in Polars DataFrames by @machow.
  • polars-permute-plugin - Polars plugin for easily reordering DataFrame columns by @lmmx.
  • polars-schema-index - Polars plugin for flattening nested data by @lmmx.
  • polars-expr-hopper - Polars plugin providing a hopper of expressions for automatic, schema-aware application by @lmmx.
  • diffly - Python utility for programatically identifying differences between Polars DataFrames including schema differences, row-level mismatches, and column value changes by @Quantco.
  • pl-compare - Compare Dataframes to find difference in the schemas, rows and column values by @concur1.
  • polarstation - Helper functions to simplify creating and working with Enums by const-ae.
  • polynx - Pandas-style query, eval, assign and group-by on string expressions, compiled to native Polars expressions with @var substitution, UDFs and LazyFrame support by @LowellWinston.

Geographical / Spatial

  • polars-h3 - Efficient hexagonal indexing for large-scale geospatial analysis by @Filimoa.
  • polars-reverse-geocode - This plugin is an offline reverse geocoder for finding the closest city to a given (latitude, longitude) pair by @MarcoGorelli.
  • polars-st - Polars plugin that provides geographical/spatial operations on Polars DataFrames, Series, and Expressions by @Oreilles.
  • polars-coord-transforms - Polars plugin for coordinates transformation and extractions features by @georgypv.
  • PyCanopy - high-performance spatial query layer for Polars, competitive with industry SQL tools in performance

Validation

  • polars-validator - Polars plugin that makes Polars DataFrames generics by @baggiponte.
  • iban_validation_polars - A package to facilitate validation of IBANs and getting bank identifier and branch identifier as a Polars plugin by @ericqu.
  • dataframely - Polars plugin that provides schema and other rule validation for Polars DataFrames by @Quantco.
  • daffy - Decorator-first DataFrame contracts/validation (columns/dtypes/constraints) at function boundaries. Supports Polars/Pandas/PyArrow/Modin by @vertti.
  • truthound - Enterprise data quality framework with 289 validators, auto-profiling, and zero-configuration schema inference by @seadonggyun4.
  • wimsey - Simple and flexible data contracts library, supports profiling and manually specified contracts in json, yaml or python by @benrutter.
  • dataprof - Data profiling and quality gates for Polars and pandas DataFrames, CSV, JSON and Parquet, written in Rust, by @AndreaBozzo.

Security / Privacy

  • maskops - Native Polars expression plugin for high-speed PII masking and detection, powered by Rust. Supports asterisk masking, HMAC-SHA256 deterministic pseudonymization, and FF3-1 format-preserving encryption. GDPR Art. 4(5)-compliant by @fcarvajalbrown.

String parsing

Text similarity / Fuzzy Matching

  • polars-distance - Polars plugin for text similarity/pairwise distance functions by @ion-elgreco.
  • polars-fuzzy-match - Python package for fuzzy matching with Polars, i.e. matching text elements that are similar but not exactly identical by bnm3k.
  • polars-strsim - Polars plugin that computes string similarity measures directly on a Polars dataframe by @foxcroftjn.
  • polars_sim - Polars plugin that implements fast approximate joins on string columns for polars dataframes by @schemaitat.

Time series / Datetime

  • polars-ts - Polars Time Series Extension that offers a wide range of metrics, feature extractors, and various tools for time series forecasting by @drumtorben.
  • polars-talib - Polars extension for Ta-Lib - support Ta-Lib functions in Polars expressions by @Yvictor.
  • polars-xdt - Polars plugin with extra-datetime-related functionalities by @MarcoGorelli.
  • polars-xdt-docs - Polars plugin for business day arithmetic by @MarcoGorelli.
  • functime - Machine learning Python package built on Polars for time-series predictions by @functime-org. According to the developpers, it’s the world’s fastest and most feature-full machine learning forecasting library !

Machine Learning & Data Science

AI

Language

Finance

Networking

httpolars - Polars plugin for HTTP operations on columns by @lmmx.

Mathematical & Statistical Functions

  • polars_ols - Polars plugin that enables fast linear model Polar expressions by @azmyrajab.
  • polars-pairing - Polars plugin that provides pairing functions that encode two natural numbers into a single natural number by @apcamargo.
  • polars_rng - Random number generation in Polars via the expression API by @alipatti.
  • polars-stats - Polars expression plugin that exposes scipy.stats-style probability distributions by @FBruzzesi.

General utilities / Performance

Statistics / Analytics

  • polars_kde - Polars plugin for kernel density estimation by @schemaitat.
  • polarscope - Polars plugin for quick data summary, cleaning and visualization of Polars dataframes by @pytoned.

Visualization

  • seaborn_polars - Python package to plot Polars DataFrames and LazyFrames with seaborn by @pavelcherepan.
  • QuickEcharts - Python package for fast and easy echarts with Polars backend by @AdrianAntico.
  • flowview - A visual debugger that shows what happens at each step of your Polars DataFrame transformations in the terminal. By @guillermodotn.
  • flexviz - Python library for interactive, cross-filterable charts on 100M+ rows, powered by lazy Polars aggregations and Rust kernels by @jvdd.

Miscellaneous

Rust

  • polars for Rust - Rust polars crate to use polars DataFrame with Rust.
  • Polars CLI Polars CLI is a command line interface for running SQL queries with Polars as backend.
  • GeoPolars Geopolars pre-alpha Rust crate that extends the Polars DataFrame library for use with geospatial data (not in active development - see top of readme).
  • plotlars plotlars is a Rust library designed to facilitate the integration between the Polars data analysis library and Plotly library.
  • iban_validation A set of projects to facilitate validation of ibans and getting the bank identifier and branch identifier in Rust, Python and Polars by @ericqu.

R

Go

  • go-polars This project creates Go bindings for Polars.

Node.js

Scala/Java

Ruby

.NET

Tools Built with Polars

  • polars-explorer - A tool that aims to provide a lightweight GUI to data exploration/manipulation tasks using Rust Polars by @brutusyhy.
  • polars-mas - A CLI tool and Python library meant to perform large scale multiple association tests, primarily seen in academic research by @idinsmore1.
  • octopolars - Pull, filter, and walk a GitHub user’s repositories with Polars by @lmmx.
  • table-diff - A tool to generate HTML/Markdown reports highlighting the differences between similar tables by @parker-research.
  • polars-query-dev-complexity - A lightweight tool for measuring the authoring complexity of Polars LazyFrame queries by @fran6w.
  • Flowfile - A visual ETL tool that builds Polars pipelines on a drag-and-drop canvas or through a Polars-like Python API, with export back to standalone Polars code, by @edwardvaneechoud.
  • Ciaren - A local-first visual ETL and ML workflow builder that runs flows on pandas or Polars and exports readable Polars or lazy Polars code, by @ciaren-labs.
  • ds-agent-playbook - Autonomous, zero-bloat recipes for Data Science pipelines: automated EDA, deterministic data cleansing, and feature hypothesis synthesis powered by Polars & DuckDB by @udbhav-shrinet.

Resources

Cheat Sheets

Books

Tutorials & workshops

Blog posts

Talks and videos

Follow

Contributing

Thanks goes to these contributors!

View this README on GitHub

推荐工具

换一个关键词,或者移除筛选条件。

安装

npx skillfish add ddotta/awesome-polars