Carlo Piovesan
banner
carlo.piovesan.io
Carlo Piovesan
@carlo.piovesan.io
Compiling @duckdb
Reposted by Carlo Piovesan
We took Canada’s Spatial Access Measures dataset (big, clunky CSVs) → turned it into a single GeoParquet file.

Add DuckDB-WASM + deck.gl & you get
- instant queries
- smooth maps
- no backend

Public data, but actually usable.
developmentseed.org/blog/2025-10...

@saadiqmohiuddin.bsky.social
November 6, 2025 at 6:38 PM
Reposted by Carlo Piovesan
I just launched github.com/tobilg/sql-w...

It's a tiny (<10kb gzipped) wrapper around @duckdb.org WASM that can run queries interactively, and be embedded in plain HTML websites, as well as all other mayor frontend frameworks...

It's an early version, feedback warmly appreciated!
GitHub - tobilg/sql-workbench-embedded: Lightweight JavaScript library that transforms static SQL code blocks into interactive, browser-based SQL execution environments using DuckDB WASM
Lightweight JavaScript library that transforms static SQL code blocks into interactive, browser-based SQL execution environments using DuckDB WASM - tobilg/sql-workbench-embedded
github.com
October 25, 2025 at 6:01 PM
Reposted by Carlo Piovesan
📣 New blog post by @dtenwolde.bsky.social.

🕸️ In this post, we show how to use DuckDB and the DuckPGQ community extension to analyze financial data for fraudulent patterns with the SQL/PGQ graph syntax that's part of SQL:2023.

📖 Visit duckdb.org/2025/10/22/d... to read the post.
October 22, 2025 at 7:23 PM
Reposted by Carlo Piovesan
In a new guest blog post, Mark Harrison (Madhive) presents Frozen DuckLakes. These are read-only DuckLakes that only require object storage and are frozen in time. He shows a process for creating and freezing DuckLakes, and demonstrates their use and performance.

📖 ducklake.select/2025/10/24/f...
October 24, 2025 at 6:38 PM
Reposted by Carlo Piovesan
Created a DNS extension for @duckdb.org today:

github.com/tobilg/duckd...

Hopefully it will be available via the Community Extensions soon!
GitHub - tobilg/duckdb-dns: DNS (Reverse) Lookup Extension for DuckDB
DNS (Reverse) Lookup Extension for DuckDB. Contribute to tobilg/duckdb-dns development by creating an account on GitHub.
github.com
October 6, 2025 at 5:50 PM
Reposted by Carlo Piovesan
Huey 1.0.10 is now released:
github.com/rpbouman/hue...
demo:
rpbouman.github.io/huey/src/ind...

- DuckDB version upgrade (1.4.0)
- Support for translation files. Currently supported: English, Dutch and Brazilian Portuguese (thanks @nosklo!)
- bugfixes and UI improvements
Release Huey version 1.0.10 - Grimao Ermaôs · rpbouman/huey
What's Changed Ensure the lists have a min-height that matches their size attribute. by @rpbouman in #580 Fix #584 by @rpbouman in #585 Fix #587 by @rpbouman in #589 Fix #590 by @rpbouman in #591 ...
github.com
September 19, 2025 at 5:22 PM
Reposted by Carlo Piovesan
Had a blast speaking about query.farm at the #DuckDB Amsterdam Meetup #3 where I had time to spend some time with my heroes @carlo.piovesan.io @samansmink.bsky.social @szarnyasg.org Tania Bogatsch and so many more awesome people! Thank You @duckdb.org for giving space to the community! #opensource
September 17, 2025 at 7:11 PM
Reposted by Carlo Piovesan
We just launched the “DuckDB in Science” site, a curated collection of papers, lectures and podcasts about DuckDB in research: duckdb.org/science/

🎡 If you would like to learn more about DuckDB in Science, consider joining our meetup in London this Thursday: www.meetup.com/duckdb/event...
September 2, 2025 at 4:59 PM
Reposted by Carlo Piovesan
🎓 On September 4, we are hosting a new kind of meetup in London which will focus on the use of DuckDB in Science and Education!

⚡️ We still have some spots for lightning talks. If you're working with DuckDB in your research and/or classroom, consider sharing your story!

🔗 duckdb.org/events/2025/...
DuckDB Meetup on Science and Education in London
DuckDB is an in-process SQL database management system focused on analytical query processing. It is designed to be easy to install and easy to use. DuckDB has no external dependencies. DuckDB has bin...
duckdb.org
August 18, 2025 at 6:41 PM
Reposted by Carlo Piovesan
We just published a deep dive on spatial joins in DuckDB by @maxxen.bsky.social.

In this blog post, Max explains how spatial joins evolved in DuckDB and how the current operator harnesses R-Trees.

Read the full post at duckdb.org/2025/08/08/s...
August 8, 2025 at 3:24 PM
Is anyone aware whether it’s possible to set CORS policies on the R2 (@cloudflare.social) Iceberg REST catalog?
cloudflare.social
July 26, 2025 at 1:15 PM
Reposted by Carlo Piovesan
Weekend project, using R2 + DuckDB wasm to build a low price frontend for big data analytics crimede-coder.com/graphs/GSUBo...
GSU Book Prices
GSU Book Prices Tables
crimede-coder.com
June 29, 2025 at 9:53 PM
Quack!!
Beyond excited to share that I'm now working with DuckDB Labs!

My first priority will be the DuckDB Rust client, which will receive a lot more love going forward.

🎉 🦆 ❤️
Signing a new freelance contract is always exciting. Being able to work on open source makes it doubly so.

Will share more soon. 😊
June 24, 2025 at 6:15 AM
Reposted by Carlo Piovesan
Beyond excited to share that I'm now working with DuckDB Labs!

My first priority will be the DuckDB Rust client, which will receive a lot more love going forward.

🎉 🦆 ❤️
Signing a new freelance contract is always exciting. Being able to work on open source makes it doubly so.

Will share more soon. 😊
June 17, 2025 at 9:59 AM
Reposted by Carlo Piovesan
My #PyConUS talk is up! Tame data science file zoos with @duckdb.org!
Read files of many shapes from any cloud, including your messiest CSVs. Then, organize all of your input tables, output tables, views, and relationships in one DuckDB file. No final_v3.csv!
youtu.be/Yq-hxgysWLQ?...
Taming file zoos: Data science with DuckDB database files - Alex Monahan
YouTube video by PyCon US
youtu.be
June 3, 2025 at 4:36 AM
Reposted by Carlo Piovesan
Yesterday DuckDB Labs announced DuckLake, a new Open data and catalog format. Here is a bit about why it is so awesome, how it solves some key problems with existing technologies, and why we're excited to host it in the cloud at MotherDuck.
S3 isn’t a database. But what if your lakehouse finally acted like one?

@jrdntgn.bsky.social shares why the current generation of lakehouse formats like Iceberg and Delta Lake might be missing the point—and how DuckLake, a new table format, changes the game.

motherduck.com/blog/ducklak...
A Duck Walks into a Lake - MotherDuck Blog
DuckDB introduces a new table format, what does it mean for the future of data lakes ? | Reading time: 9 min read
motherduck.com
May 28, 2025 at 11:16 AM
Reposted by Carlo Piovesan
Ducklake is a really elegant solution to the data lake. Radically simple and completely open.
duckdb.org DuckDB @duckdb.org · May 27
Today we're launching DuckLake, an integrated data lake and catalog format powered by SQL. DuckLake unlocks next-generation data warehousing where compute is local, consistency central, and storage scales till infinity. ⁠ducklake is an open standard and we implemented it in the "ducklake" extension.
May 27, 2025 at 10:26 PM
And the biggest winner is... DuckDB support for running queries on [remote] parquet files.
This happens to be a basic building block of DuckLake and a few other alternative lake technologies
duckdb.org DuckDB @duckdb.org · May 27
Today we're launching DuckLake, an integrated data lake and catalog format powered by SQL. DuckLake unlocks next-generation data warehousing where compute is local, consistency central, and storage scales till infinity. ⁠ducklake is an open standard and we implemented it in the "ducklake" extension.
May 27, 2025 at 2:12 PM
Reposted by Carlo Piovesan
Today we're launching DuckLake, an integrated data lake and catalog format powered by SQL. DuckLake unlocks next-generation data warehousing where compute is local, consistency central, and storage scales till infinity. ⁠ducklake is an open standard and we implemented it in the "ducklake" extension.
May 27, 2025 at 1:12 PM
Reposted by Carlo Piovesan
Our USING KEY variant of recursive CTEs has landed in DuckDB 1.3 Formerly an off-the-beaten-path researchy idea, now available in a real off-the-shelf DBMS. Hooray! 🎉

duckdb.org/2025/05/23/u...
USING KEY in Recursive CTEs
Recursive CTEs in SQL allow for powerful iterative queries like graph traversals but can be memory-intensive and slow due to repeated row accumulation. DuckDB’s new USING KEY feature addresses this by...
duckdb.org
May 22, 2025 at 5:54 PM
Reposted by Carlo Piovesan
New post by Pedro Holanda, Ian Cook, Dewey Dunnington and Bryce Mecum:

Arrow IPC Support in DuckDB

This blog post introduces the new arrow community extension, which boosts interoperability by allowing to consume/produce data through the Arrow IPC Serialization Format.

duckdb.org/2025/05/23/a...
May 23, 2025 at 1:25 PM
Reposted by Carlo Piovesan
DuckDB v1.3.0 “Ossivalis” is out and it packs a ton of new features, fixes and optimizations.

See the announcement blog post: duckdb.org/2025/05/21/a...
May 21, 2025 at 4:37 PM
Reposted by Carlo Piovesan
A new preprint from database researchers found DuckDB the most environmentally efficient system: arxiv.org/pdf/2504.18980
May 1, 2025 at 10:04 AM
Reposted by Carlo Piovesan
So thrilled to announce we've released Instant SQL in both the MotherDuck and DuckDB UIs!

It's a new interaction pattern for writing SQL queries that provides realtime result previews and deep query inspection & debugging. Bye bye run button 👋

Truly, literally only possible with DuckDB
April 24, 2025 at 8:57 PM