Apache Arrow DataFusion

Input—per 1M tokens

Output—per 1M tokens

Context—tokens

WeightsClosed

About

Apache Arrow DataFusion is ranked #15 of 25 in query engine software on Inferse. It runs on Linux, macOS, Self-hosted. There is a free plan.

Compared on query engine software

Free plan: Yesdatafusion.apache.org
Federated queries: Yesdatafusion.apache.org
Heterogeneous sources: Yesdatafusion.apache.org
Deployment: self_hosteddatafusion.apache.org
SQL support: fulldatafusion.apache.org
Streaming sources: Yesdatafusion.apache.org

Facts

Product: Apache DataFusion is an extensible query engine written in Rust that uses Apache Arrow as its in-memory format.datafusion.apache.org · 29 Sept 2026
Intended users: The core project provides libraries and binaries for developers building database and analytics systems customized to particular workloads.datafusion.apache.org · 29 Sept 2026
Execution: DataFusion runs queries in-process using threads for parallel query execution.datafusion.apache.org · 29 Sept 2026
APIs: DataFusion offers SQL and DataFrame APIs, and related subprojects provide Python and Java interfaces.datafusion.apache.org · 29 Sept 2026
Query features: Documented features include SQL parsing and planning, parallel and streaming execution, and query optimization.datafusion.apache.org · 29 Sept 2026
Formats: Built-in data source support includes CSV, Parquet, JSON, Avro, and Arrow.datafusion.apache.org · 29 Sept 2026
Extensibility: Developers can add data sources through the TableProvider trait and customize functions, operators, and other components.datafusion.apache.org · 29 Sept 2026
Runtime limits: Documented runtime features include enforced memory limits and disk spilling for sorts, grouping, and joins.datafusion.apache.org · 29 Sept 2026
Distribution: The core DataFusion project is designed for in-process use; Ballista is a related distributed processing extension.datafusion.apache.org · 29 Sept 2026
Downloads: Rust users commonly add DataFusion from crates.io, while official Apache releases are provided as source artifacts.datafusion.apache.org · 29 Sept 2026
Release verification: The download page recommends verifying release artifacts with an OpenPGP signature or SHA-512 checksum.datafusion.apache.org · 29 Sept 2026
Support: The project directs users to its community communication channels for getting in touch.datafusion.apache.org · 29 Sept 2026
Governance: The project is governed through the Apache Software Foundation process.datafusion.apache.org · 29 Sept 2026