Tag:apache arrow
All the articles with the tag "apache arrow".
- 31 MIN READ•Aug 25, 2026
Arrow Flight SQL and ADBC: Why the Database Driver Is the Slowest Part of Your Query
JDBC and ODBC often dominate large-result time. Flight SQL and ADBC keep data columnar from server to client, with Python, Go, and Rust examples.
Apache ArrowFlight SQLADBC - 31 MIN READ•Aug 6, 2026
Apache Arrow Flight and ADBC, and Why Database Connectivity Finally Went Columnar
Arrow Flight and ADBC move database results as columnar data, ending the row-oriented bottleneck between engines and applications. Here's how.
Apache ArrowADBCArrow Flight - 31 MIN READ•Jul 24, 2026
The Breakdown of the Open Lakehouse in 2026: Iceberg, Arrow, Polaris, Parquet, and Ossie, and How to Actually Build One
A detailed breakdown of the five Apache projects powering the open lakehouse in 2026 -- Parquet, Iceberg, Polaris, Arrow, and Ossie -- and how to build one yourself or use a managed platform.
Apache IcebergApache ParquetApache Arrow - 28 MIN READ•Jul 6, 2026
The State of Apache Arrow in 2026: Ten Years In, the Invisible Standard Is Everywhere
Apache Arrow at 10 — ADBC, Flight SQL, nanoarrow, the AI reinterpretation, and how an in-memory standard eliminated the copy tax across the data stack.
Apache Arrowdata engineeringlakehouse architecture - 24 MIN READ•May 23, 2026
Single-Node Data Engineering: DuckDB, DataFusion, Polars, and LakeSail
Optimize single-node data engineering with DuckDB, DataFusion, Polars, and LakeSail. Compare architectures and learn when to transition to Dremio MPP.
DuckDBApache ArrowDataFusion - 4 MIN READ•Mar 7, 2026
Agentic Analytics on the Apache Lakehouse
If you grant a Large Language Model direct access to a raw Amazon S3 bucket filled with Parquet files, it will fail to answer your business questions....
data lakehouseapache icebergapache parquet - 4 MIN READ•Mar 7, 2026
What is Apache Arrow? Erasing the Serialization Tax
If you pull a million records from a database into a Python notebook, the query runs instantly, but the transfer feels endlessly slow. Your compute en...
data lakehouseapache icebergapache parquet - 5 MIN READ•Mar 7, 2026
What is Apache Iceberg? The Table Format Revolution
If you drop ten thousand Parquet files into an S3 bucket, you have a data swamp. You do not have a database. To run SQL queries against those files sa...
data lakehouseapache icebergapache parquet - 4 MIN READ•Mar 7, 2026
What is Apache Parquet? Columns, Encoding, and Performance
If you ask a data analyst to calculate the average transaction amount for the month of July using a massive CSV file, the compute engine must read eve...
data lakehouseapache icebergapache parquet - 21 MIN READ•Mar 7, 2026
What is Apache Polaris? Unifying the Iceberg Ecosystem
Treating thousands of Parquet files as a unified database table requires a brain. Apache Iceberg provides the metadata structure to do this, but the Iceberg specification alone does not manage security roles, handle network requests, or broker credentials. You need an open catalog service to orchestrate those root metadata pointers. Apache Polaris serves as that open-source, vendor-neutral brain. This comprehensive guide explains the catalog fragmentation war, open governance under the Apache Software Foundation, role-based access control hierarchies, credential vending vs IAM sprawl, and how Polaris powers Dremio's agentic query acceleration.
data lakehouseapache icebergapache parquet - 6 MIN READ•Mar 7, 2026
Apache Software Foundation: History, Purpose, and Process
If you build a modern data lakehouse, you inevitably stack Apache Iceberg, Apache Parquet, and Apache Arrow. These projects dictate how you store, que...
data lakehouseapache icebergapache parquet - 4 MIN READ•Mar 7, 2026
Assembling the Apache Lakehouse: The Modular Architecture
For decades, the standard data architecture was monolithic. When you bought a data warehouse, you bought a single box where the vendor tightly coupled...
data lakehouseapache icebergapache parquet