Joris Gillis
@jorisgillis.name
Software Engineer interested in Database, Time Series and Programming Languages.
Blog: https://jorisgillis.name
GitHub: https://github.com/jorisgillis
SourceHut: https://sr.ht/~jgillis/
Blog: https://jorisgillis.name
GitHub: https://github.com/jorisgillis
SourceHut: https://sr.ht/~jgillis/
Reposted by Joris Gillis
“Parquet is great… until GPUs, multimodal data & million-column schemas show up.”
The creator of pandas/Arrow @wesmckinney.com digs into Arrow vs Parquet, new columnar + table formats, DataFusion/DuckDB, metadata headaches, and what AI coding agents mean for open source infra.
Episode link below
The creator of pandas/Arrow @wesmckinney.com digs into Arrow vs Parquet, new columnar + table formats, DataFusion/DuckDB, metadata headaches, and what AI coding agents mean for open source infra.
Episode link below
December 2, 2025 at 5:30 PM
“Parquet is great… until GPUs, multimodal data & million-column schemas show up.”
The creator of pandas/Arrow @wesmckinney.com digs into Arrow vs Parquet, new columnar + table formats, DataFusion/DuckDB, metadata headaches, and what AI coding agents mean for open source infra.
Episode link below
The creator of pandas/Arrow @wesmckinney.com digs into Arrow vs Parquet, new columnar + table formats, DataFusion/DuckDB, metadata headaches, and what AI coding agents mean for open source infra.
Episode link below
Reposted by Joris Gillis
Correction: @glaredb.bsky.social is moving *away* from DataFusion! Their talk discusses the problems with building a DBMS using off-shelf parts. Like @duckdb.org, the new GlareDB rewrite borrows ideas from the Germans' HyPer system but it's written in Rust: www.youtube.com/watch?v=Sor3...
November 20, 2024 at 11:14 AM
Correction: @glaredb.bsky.social is moving *away* from DataFusion! Their talk discusses the problems with building a DBMS using off-shelf parts. Like @duckdb.org, the new GlareDB rewrite borrows ideas from the Germans' HyPer system but it's written in Rust: www.youtube.com/watch?v=Sor3...
Reposted by Joris Gillis
New EuroRust talk out on YouTube 🙌 Here, Michele walks us through how Rust is reshaping data engineering, with high-performance pipelines built on arrow-rs, datafusion, and delta-rs 🦀
Check out the talk 👉 youtu.be/9zq8JbGo7ow
Check out the talk 👉 youtu.be/9zq8JbGo7ow
Data Engineering with Rust - Michele Vigilante | EuroRust 2025
Data Engineering with Rust - Michele Vigilante at EuroRust 2025 🦀
Data engineering has long been the domain of JVM-based and Python ecosystems—think Apache Spark, Hadoop, and pandas. Rust’s…
youtu.be
December 11, 2025 at 9:32 AM
New EuroRust talk out on YouTube 🙌 Here, Michele walks us through how Rust is reshaping data engineering, with high-performance pipelines built on arrow-rs, datafusion, and delta-rs 🦀
Check out the talk 👉 youtu.be/9zq8JbGo7ow
Check out the talk 👉 youtu.be/9zq8JbGo7ow
Reposted by Joris Gillis
Awesome reading list about Apache DataFusion. I started diving into it lately, hacking an extension to have Elasticsearch as a data source (aka a TableProvider). It's a wonderful piece of software and an impressive ecosystem. datafusion.apache.org/user-guide/c...
November 14, 2024 at 7:55 AM
Awesome reading list about Apache DataFusion. I started diving into it lately, hacking an extension to have Elasticsearch as a data source (aka a TableProvider). It's a wonderful piece of software and an impressive ecosystem. datafusion.apache.org/user-guide/c...
Reposted by Joris Gillis
Latest Apache DataFusion blog: more efficient plans and how to efficiently contribute: datafusion.apache.org/blog/output/...
December 20, 2025 at 12:37 PM
Latest Apache DataFusion blog: more efficient plans and how to efficiently contribute: datafusion.apache.org/blog/output/...
Wrote blogpost on how to implement Apache Arrow Flight SQL using Java and Apache DataFusion.
jorisgillis.name/2025/11/16/j...
jorisgillis.name/2025/11/16/j...
Building an Apache Arrow Flight SQL Server in Java
Apache Arrow defines a language-independent columnar memory format for flat and nested data, organized for efficient analytic operations on modern hardware l...
jorisgillis.name
December 15, 2025 at 11:49 AM
Wrote blogpost on how to implement Apache Arrow Flight SQL using Java and Apache DataFusion.
jorisgillis.name/2025/11/16/j...
jorisgillis.name/2025/11/16/j...
Reposted by Joris Gillis
Do you like databases?
Do you want to hear two database professors rant about them?
Do you need one of those professors to have a Turing Award for databases?
If yes, then join Mike Stonebraker and I next Wed Dec 10 @ 1:00pm EST for database hot takes: www.dbos.dev/webcast-2025...
Do you want to hear two database professors rant about them?
Do you need one of those professors to have a Turing Award for databases?
If yes, then join Mike Stonebraker and I next Wed Dec 10 @ 1:00pm EST for database hot takes: www.dbos.dev/webcast-2025...
2025 in Review with Mike Stonebraker and Andy Pavlo
Webcast Dec 10: DBMS researchers Mike Stonebraker (MIT / DBOS) and Andy Pavlo (CMU) discuss which data and CS trends are heating up or cooling down heading into 2026.
www.dbos.dev
December 5, 2025 at 11:29 PM
Do you like databases?
Do you want to hear two database professors rant about them?
Do you need one of those professors to have a Turing Award for databases?
If yes, then join Mike Stonebraker and I next Wed Dec 10 @ 1:00pm EST for database hot takes: www.dbos.dev/webcast-2025...
Do you want to hear two database professors rant about them?
Do you need one of those professors to have a Turing Award for databases?
If yes, then join Mike Stonebraker and I next Wed Dec 10 @ 1:00pm EST for database hot takes: www.dbos.dev/webcast-2025...