Ian Cook
@ian.columnar.tech
I work on Apache Arrow and obsess about interoperability and performance in data analytics systems
Reposted by Ian Cook
A new startup, @columnar.tech, looks to streamline the copying of tabular data across systems, using @arrow.apache.org and the ADBC API.
By @joabj.bsky.social
By @joabj.bsky.social
Apache Arrow's Final Frontier: Replacing Outdated Database Drivers
A new startup, Columnar, looks to streamline the copying of tabular data across systems, using Apache Arrow and the ADBC API.
bit.ly
November 3, 2025 at 7:00 PM
A new startup, @columnar.tech, looks to streamline the copying of tabular data across systems, using @arrow.apache.org and the ADBC API.
By @joabj.bsky.social
By @joabj.bsky.social
Reposted by Ian Cook
At Row Zero we get amazing speeds ingesting data from Snowflake and other databases that can export column-oriented data. But there's a long tail of data stores that we're forced to slow down for, because they only allow row-oriented export. Here's hoping we can change that!
The future of data connectivity is columnar. Today we launched
@columnar.tech to accelerate the shift from slow, row-oriented APIs like ODBC and JDBC to >10x faster alternatives powered by @arrow.apache.org. Learn more 👇
@columnar.tech to accelerate the shift from slow, row-oriented APIs like ODBC and JDBC to >10x faster alternatives powered by @arrow.apache.org. Learn more 👇
Announcing Columnar
Back to the future of data connectivity
columnar.tech
October 29, 2025 at 11:14 PM
At Row Zero we get amazing speeds ingesting data from Snowflake and other databases that can export column-oriented data. But there's a long tail of data stores that we're forced to slow down for, because they only allow row-oriented export. Here's hoping we can change that!
The future of data connectivity is columnar. Today we launched
@columnar.tech to accelerate the shift from slow, row-oriented APIs like ODBC and JDBC to >10x faster alternatives powered by @arrow.apache.org. Learn more 👇
@columnar.tech to accelerate the shift from slow, row-oriented APIs like ODBC and JDBC to >10x faster alternatives powered by @arrow.apache.org. Learn more 👇
Announcing Columnar
Back to the future of data connectivity
columnar.tech
October 29, 2025 at 10:51 PM
The future of data connectivity is columnar. Today we launched
@columnar.tech to accelerate the shift from slow, row-oriented APIs like ODBC and JDBC to >10x faster alternatives powered by @arrow.apache.org. Learn more 👇
@columnar.tech to accelerate the shift from slow, row-oriented APIs like ODBC and JDBC to >10x faster alternatives powered by @arrow.apache.org. Learn more 👇
ODBC is getting tired. It just can't keep up with the fast new kids in the data world these days. The next generation is ready to take the torch. Meet ADBC, a fast, modern data connectivity standard built on @arrow.apache.org. Watch my new talk from the @db.cs.cmu.edu seminar: youtu.be/TjlmNGNx77E
Where We’re Going, We Don’t Need Rows: Columnar Data Connectivity with Apache Arrow ADBC (Ian Cook)
YouTube video by CMU Database Group
youtu.be
October 23, 2025 at 3:52 PM
ODBC is getting tired. It just can't keep up with the fast new kids in the data world these days. The next generation is ready to take the torch. Meet ADBC, a fast, modern data connectivity standard built on @arrow.apache.org. Watch my new talk from the @db.cs.cmu.edu seminar: youtu.be/TjlmNGNx77E
Reposted by Ian Cook
Today's Future Data Systems Seminar Speaker: Ian Cook (@ian.columnar.tech) will present @columnar.tech's work on Apache Arrow's database connectivity API (ADBC). ADBC is available in modern DBMSs. Zoom talk open to public at 4:30pm ET. YouTube video available after: db.cs.cmu.edu/events/futur...
[Future Data] Where We're Going, We Don't Need Rows: Columnar Data Connectivity with ADBC - Carnegie Mellon Database Group
ADBC (Arrow Database Connectivity) is Apache Arrow’s answer to ODBC and JDBC:... Read More +
db.cs.cmu.edu
October 20, 2025 at 11:38 AM
Today's Future Data Systems Seminar Speaker: Ian Cook (@ian.columnar.tech) will present @columnar.tech's work on Apache Arrow's database connectivity API (ADBC). ADBC is available in modern DBMSs. Zoom talk open to public at 4:30pm ET. YouTube video available after: db.cs.cmu.edu/events/futur...
Reposted by Ian Cook
Register for the Apache Arrow Summit Paris 25 (October 2nd) at: www.meetup.com/pydata-paris...
The event is hosted by @pydataparis.bsky.social
We are looking forward to seeing you there and talking about all things Arrow.
The event is hosted by @pydataparis.bsky.social
We are looking forward to seeing you there and talking about all things Arrow.
Apache Arrow Summit, Thu, Oct 2, 2025, 9:30 AM | Meetup
The day after the PyData Paris conference, we’re excited to host the first-ever Apache Arrow Summit - a gathering dedicated to fostering collaboration and innovation within
www.meetup.com
August 28, 2025 at 7:50 AM
Register for the Apache Arrow Summit Paris 25 (October 2nd) at: www.meetup.com/pydata-paris...
The event is hosted by @pydataparis.bsky.social
We are looking forward to seeing you there and talking about all things Arrow.
The event is hosted by @pydataparis.bsky.social
We are looking forward to seeing you there and talking about all things Arrow.
Reposted by Ian Cook
In September the @columnar.tech crew are headed to PyData Paris 2025 and the first ever Apache Arrow Summit. The organizer @quantstack.bsky.social is a dedicated supporter of @arrow.apache.org. We’re delighted to be sponsoring the event.
August 18, 2025 at 2:30 PM
In September the @columnar.tech crew are headed to PyData Paris 2025 and the first ever Apache Arrow Summit. The organizer @quantstack.bsky.social is a dedicated supporter of @arrow.apache.org. We’re delighted to be sponsoring the event.
Reposted by Ian Cook
Next Tuesday, get ready to meet the mind behind #Pandas & #ApacheArrow!
@wesmckinney.com shares his origin story (Part 1) on #TheTestSet. From speedruns to shaping the data stack, this is one you won't want to miss.
Mark your calendar for Tuesday & subscribe at thetestset.co!
#DataScience #Python
@wesmckinney.com shares his origin story (Part 1) on #TheTestSet. From speedruns to shaping the data stack, this is one you won't want to miss.
Mark your calendar for Tuesday & subscribe at thetestset.co!
#DataScience #Python
July 11, 2025 at 1:57 PM
Next Tuesday, get ready to meet the mind behind #Pandas & #ApacheArrow!
@wesmckinney.com shares his origin story (Part 1) on #TheTestSet. From speedruns to shaping the data stack, this is one you won't want to miss.
Mark your calendar for Tuesday & subscribe at thetestset.co!
#DataScience #Python
@wesmckinney.com shares his origin story (Part 1) on #TheTestSet. From speedruns to shaping the data stack, this is one you won't want to miss.
Mark your calendar for Tuesday & subscribe at thetestset.co!
#DataScience #Python
New post by Pedro Holanda, Ian Cook, Dewey Dunnington and Bryce Mecum:
Arrow IPC Support in DuckDB
This blog post introduces the new arrow community extension, which boosts interoperability by allowing to consume/produce data through the Arrow IPC Serialization Format.
duckdb.org/2025/05/23/a...
Arrow IPC Support in DuckDB
This blog post introduces the new arrow community extension, which boosts interoperability by allowing to consume/produce data through the Arrow IPC Serialization Format.
duckdb.org/2025/05/23/a...
May 23, 2025 at 3:24 PM
Reposted by Ian Cook
🚀 Introducing **Bauplan**
A serverless, code-native platform for building data and AI pipelines — directly on your object store. No clusters. No notebooks. No GUI based workflows.
Just Python + SQL + S3.
👉 www.bauplanlabs.com/blog/hello-b...
A serverless, code-native platform for building data and AI pipelines — directly on your object store. No clusters. No notebooks. No GUI based workflows.
Just Python + SQL + S3.
👉 www.bauplanlabs.com/blog/hello-b...
April 16, 2025 at 2:14 PM
🚀 Introducing **Bauplan**
A serverless, code-native platform for building data and AI pipelines — directly on your object store. No clusters. No notebooks. No GUI based workflows.
Just Python + SQL + S3.
👉 www.bauplanlabs.com/blog/hello-b...
A serverless, code-native platform for building data and AI pipelines — directly on your object store. No clusters. No notebooks. No GUI based workflows.
Just Python + SQL + S3.
👉 www.bauplanlabs.com/blog/hello-b...
2025 is shaping up to be a breakout year for fast query result transfer with Apache Arrow. But what exactly makes it so fast? David Li, Matt Topol, and I break it down in this new blog post: arrow.apache.org/blog/2025/01...
How the Apache Arrow Format Accelerates Query Result Transfer
Arrow speeds up query result transfer by slashing (de)serialization overheads. We outline five key attributes of the Arrow format that enable this.
arrow.apache.org
January 13, 2025 at 4:25 PM
2025 is shaping up to be a breakout year for fast query result transfer with Apache Arrow. But what exactly makes it so fast? David Li, Matt Topol, and I break it down in this new blog post: arrow.apache.org/blog/2025/01...
Reposted by Ian Cook
[🎥 Watch] Apache Arrow is a columnar format and multi-language toolbox for fast data interchange and in-memory analytics.
Matt Topol, Arrow PMC member, talks about Arrow subprojects and how you can get involved with the project. https://buff.ly/40qNPAL
#opensource
Matt Topol, Arrow PMC member, talks about Arrow subprojects and how you can get involved with the project. https://buff.ly/40qNPAL
#opensource
January 7, 2025 at 9:45 PM
[🎥 Watch] Apache Arrow is a columnar format and multi-language toolbox for fast data interchange and in-memory analytics.
Matt Topol, Arrow PMC member, talks about Arrow subprojects and how you can get involved with the project. https://buff.ly/40qNPAL
#opensource
Matt Topol, Arrow PMC member, talks about Arrow subprojects and how you can get involved with the project. https://buff.ly/40qNPAL
#opensource
The best illustration of how users and buyers of a product can have opposite priorities
Jiffy Express - Saturday Night Live
YouTube video by Saturday Night Live
youtu.be
December 19, 2024 at 2:54 PM
The best illustration of how users and buyers of a product can have opposite priorities
Reposted by Ian Cook
Would love to see more discussion of this. To Andy's point we have this wonderful Arrow eco system that's underdeveloped. In a world of columnar data we're still stuck using ODBC/JDBC for connectivity to most data systems. Hard to get some vendors to even talk about ADBC.
I was recently on a panel on "What are important data systems problems, ignored by research?" with @andypavlo.bsky.social and Allison Lee moderated by Viktor Leis - here is the write-up of the discussion databasearchitects.blogspot.com/2024/12/what...
What are important data systems problems, ignored by research?
A blog by and for database architects.
databasearchitects.blogspot.com
December 13, 2024 at 8:59 PM
Would love to see more discussion of this. To Andy's point we have this wonderful Arrow eco system that's underdeveloped. In a world of columnar data we're still stuck using ODBC/JDBC for connectivity to most data systems. Hard to get some vendors to even talk about ADBC.
Base64 decoding error on my Food Lion receipt today
November 20, 2024 at 2:56 PM
Base64 decoding error on my Food Lion receipt today
It's 2024 and there's still no way to download just one subdirectory of a Git repo without using a sketchy third-party website or tool? Wild.
November 14, 2024 at 12:58 AM
It's 2024 and there's still no way to download just one subdirectory of a Git repo without using a sketchy third-party website or tool? Wild.