Marco Slot
@marcoslot.com
Mostly posts about PostgreSQL, Snowflake Postgres, and PostgreSQL extensions.
Formerly Crunchy Data, Microsoft, Citus Data, AWS, TCD, VU
Formerly Crunchy Data, Microsoft, Citus Data, AWS, TCD, VU
pg_lake just went open source! (Apache 2.0)
pg_lake is a set of extensions (from Crunchy Data Warehouse) that add comprehensive Iceberg support and data lake access to Postgres, with @duckdb.org transparently integrated into the query engine.
Announcement blog: www.snowflake.com/en/engineeri...
pg_lake is a set of extensions (from Crunchy Data Warehouse) that add comprehensive Iceberg support and data lake access to Postgres, with @duckdb.org transparently integrated into the query engine.
Announcement blog: www.snowflake.com/en/engineeri...
November 4, 2025 at 4:04 PM
pg_lake just went open source! (Apache 2.0)
pg_lake is a set of extensions (from Crunchy Data Warehouse) that add comprehensive Iceberg support and data lake access to Postgres, with @duckdb.org transparently integrated into the query engine.
Announcement blog: www.snowflake.com/en/engineeri...
pg_lake is a set of extensions (from Crunchy Data Warehouse) that add comprehensive Iceberg support and data lake access to Postgres, with @duckdb.org transparently integrated into the query engine.
Announcement blog: www.snowflake.com/en/engineeri...
Generative AI comes up with details that would be hilarious, if it wasn't so mind boggling that it can come up with these details.
May 4, 2025 at 9:33 PM
Generative AI comes up with details that would be hilarious, if it wasn't so mind boggling that it can come up with these details.
And there it is: Native logical replication from any Postgres server to Iceberg managed by Crunchy Data Warehouse.
Speed up Postgres analytical queries 100x with 2 commands.
Speed up Postgres analytical queries 100x with 2 commands.
April 22, 2025 at 2:48 PM
And there it is: Native logical replication from any Postgres server to Iceberg managed by Crunchy Data Warehouse.
Speed up Postgres analytical queries 100x with 2 commands.
Speed up Postgres analytical queries 100x with 2 commands.
Auto-vacuum for #Iceberg tables is now available in Crunchy Data Warehouse!
We're always aiming for a 0-touch experience where possible, so we went out of our way to make Iceberg compaction & cleanup fully automatic without any configuration.
Still pretty interesting to see a manual vacuum:
We're always aiming for a 0-touch experience where possible, so we went out of our way to make Iceberg compaction & cleanup fully automatic without any configuration.
Still pretty interesting to see a manual vacuum:
March 11, 2025 at 2:56 PM
Auto-vacuum for #Iceberg tables is now available in Crunchy Data Warehouse!
We're always aiming for a 0-touch experience where possible, so we went out of our way to make Iceberg compaction & cleanup fully automatic without any configuration.
Still pretty interesting to see a manual vacuum:
We're always aiming for a 0-touch experience where possible, so we went out of our way to make Iceberg compaction & cleanup fully automatic without any configuration.
Still pretty interesting to see a manual vacuum:
Postgres is increasingly becoming a versatile data platform, instead of just an operational database.
Using pg_parquet you can trivially export data to S3, and using Crunchy Data Warehouse you can just as easily query or import Parquet files from PostgreSQL.
Using pg_parquet you can trivially export data to S3, and using Crunchy Data Warehouse you can just as easily query or import Parquet files from PostgreSQL.
February 7, 2025 at 11:11 AM
Postgres is increasingly becoming a versatile data platform, instead of just an operational database.
Using pg_parquet you can trivially export data to S3, and using Crunchy Data Warehouse you can just as easily query or import Parquet files from PostgreSQL.
Using pg_parquet you can trivially export data to S3, and using Crunchy Data Warehouse you can just as easily query or import Parquet files from PostgreSQL.
Deepseek R1 in an ollama "container app" on a managed Postgres server, because... why not?
January 28, 2025 at 3:50 PM
Deepseek R1 in an ollama "container app" on a managed Postgres server, because... why not?
End-to-end demo of the new pg_incremental extension.
There's raw events table and a summary table containing view counts.
You then define a pipeline using an insert..select command, and keeps running that to do fast, reliable, incremental processing in the background.
There's raw events table and a summary table containing view counts.
You then define a pipeline using an insert..select command, and keeps running that to do fast, reliable, incremental processing in the background.
December 17, 2024 at 5:35 PM
End-to-end demo of the new pg_incremental extension.
There's raw events table and a summary table containing view counts.
You then define a pipeline using an insert..select command, and keeps running that to do fast, reliable, incremental processing in the background.
There's raw events table and a summary table containing view counts.
You then define a pipeline using an insert..select command, and keeps running that to do fast, reliable, incremental processing in the background.
It's also not so easy to get started right now, with only Spark supporting the catalog and no way to create tables without a query engine. Presumably that will improve quickly.
Still, I think this is what getting started with Iceberg should look like:
Still, I think this is what getting started with Iceberg should look like:
December 4, 2024 at 10:21 PM
It's also not so easy to get started right now, with only Spark supporting the catalog and no way to create tables without a query engine. Presumably that will improve quickly.
Still, I think this is what getting started with Iceberg should look like:
Still, I think this is what getting started with Iceberg should look like:
November 22, 2024 at 1:30 PM
The performance difference between Iceberg and heap tables for analytical operations in Crunchy Data Warehouse can be pretty big.
But you really start noticing the difference when you run through several steps.
But you really start noticing the difference when you run through several steps.
November 20, 2024 at 9:31 PM
The performance difference between Iceberg and heap tables for analytical operations in Crunchy Data Warehouse can be pretty big.
But you really start noticing the difference when you run through several steps.
But you really start noticing the difference when you run through several steps.
Quick demo of Iceberg in PostgreSQL with Crunchy Data Warehouse.
Create an Iceberg table from a file, load some more data, and run fast queries.
Create an Iceberg table from a file, load some more data, and run fast queries.
November 20, 2024 at 5:32 PM
Quick demo of Iceberg in PostgreSQL with Crunchy Data Warehouse.
Create an Iceberg table from a file, load some more data, and run fast queries.
Create an Iceberg table from a file, load some more data, and run fast queries.
Playing with @pwramsey.bsky.social 's OpenAI extension on Crunchy Bridge 🤯
November 14, 2024 at 10:40 AM
Playing with @pwramsey.bsky.social 's OpenAI extension on Crunchy Bridge 🤯