Crunchy Data
@crunchydata.com
Just Postgres www.crunchydata.com
Today we're announcing the availability of logical replication from Postgres to Iceberg with Crunchy Data Warehouse.
Now you can seamlessly move data and stream changes from your operational database into an analytical system.
www.crunchydata.com/blog/logical...
Now you can seamlessly move data and stream changes from your operational database into an analytical system.
www.crunchydata.com/blog/logical...
Logical replication from Postgres to Iceberg | Crunchy Data Blog
We've launched native logical replication from Postgres tables in any Postgres server to Iceberg tables managed by Crunchy Data Warehouse.
www.crunchydata.com
April 22, 2025 at 2:26 PM
Today we're announcing the availability of logical replication from Postgres to Iceberg with Crunchy Data Warehouse.
Now you can seamlessly move data and stream changes from your operational database into an analytical system.
www.crunchydata.com/blog/logical...
Now you can seamlessly move data and stream changes from your operational database into an analytical system.
www.crunchydata.com/blog/logical...
How long has it been since you checked your cache hit ratio?
Ideally most of your frequently queried data is in the buffer cache. We recommend 98-99% in the cache for transactional workloads - analytical workloads are lower.
Ideally most of your frequently queried data is in the buffer cache. We recommend 98-99% in the cache for transactional workloads - analytical workloads are lower.
April 17, 2025 at 2:36 PM
How long has it been since you checked your cache hit ratio?
Ideally most of your frequently queried data is in the buffer cache. We recommend 98-99% in the cache for transactional workloads - analytical workloads are lower.
Ideally most of your frequently queried data is in the buffer cache. We recommend 98-99% in the cache for transactional workloads - analytical workloads are lower.
Postgres + Iceberg side-by-side next to the same query with a Postgres HEAP table.
Half a millisecond for the optimized 🔥 . 10 seconds for the long method.
www.crunchydata.com/products/war...
Half a millisecond for the optimized 🔥 . 10 seconds for the long method.
www.crunchydata.com/products/war...
April 16, 2025 at 6:36 PM
Postgres + Iceberg side-by-side next to the same query with a Postgres HEAP table.
Half a millisecond for the optimized 🔥 . 10 seconds for the long method.
www.crunchydata.com/products/war...
Half a millisecond for the optimized 🔥 . 10 seconds for the long method.
www.crunchydata.com/products/war...
psql tip: find your config parameters that are not default with \dconfig.
List of non-default configuration parameters:
List of non-default configuration parameters:
April 16, 2025 at 4:43 PM
psql tip: find your config parameters that are not default with \dconfig.
List of non-default configuration parameters:
List of non-default configuration parameters:
Postgres does a good job of keeping internal statistics of your which are used to plan how queries are executed. But Postgres doesn't always know how columns are related. In this deep dive we look at hacking the statistics for improved performance
Hacking the Postgres Statistics Tables for Faster Queries | Crunchy Data Blog
Adding extended statistics can add information about how columns are related. Louise has some real life example queries and tips for working with extended table stats that can dramatically improve…
www.crunchydata.com
April 16, 2025 at 1:55 PM
Postgres does a good job of keeping internal statistics of your which are used to plan how queries are executed. But Postgres doesn't always know how columns are related. In this deep dive we look at hacking the statistics for improved performance
Miss our webinar on running Crunchy Data Warehouse on-premises? We cover an overview, hands on walk through with live querying our data lake to full Iceberg creation, and highlight of popular use cases for it. If you missed it don't worry we got you covered.
www.youtube.com/watch?v=Vojg...
www.youtube.com/watch?v=Vojg...
Crunchy Data Warehouse: Postgres + Iceberg for Your On-premises Data Lake
YouTube video by Crunchy Data
www.youtube.com
April 15, 2025 at 2:15 PM
Miss our webinar on running Crunchy Data Warehouse on-premises? We cover an overview, hands on walk through with live querying our data lake to full Iceberg creation, and highlight of popular use cases for it. If you missed it don't worry we got you covered.
www.youtube.com/watch?v=Vojg...
www.youtube.com/watch?v=Vojg...
We all love pg_stat_statements but that data collects forever and can get a little stale. When should you reset it?
Here are some tips from our support team.
Here are some tips from our support team.
April 15, 2025 at 1:45 PM
We all love pg_stat_statements but that data collects forever and can get a little stale. When should you reset it?
Here are some tips from our support team.
Here are some tips from our support team.
Excited to announce Crunchy Data Warehouse is now available for Kubernetes and On-premises. Need faster analytics from Postgres? Want a native Postgres data lake experience? Learn more about how it works: www.crunchydata.com/blog/crunchy...
Crunchy Data Warehouse: Postgres with Iceberg Available for Kubernetes and On-premises | Crunchy Data Blog
Crunchy Data brings Postgres-native Apache Iceberg to Kubernetes and on-prem workloads.
www.crunchydata.com
April 1, 2025 at 3:56 PM
Excited to announce Crunchy Data Warehouse is now available for Kubernetes and On-premises. Need faster analytics from Postgres? Want a native Postgres data lake experience? Learn more about how it works: www.crunchydata.com/blog/crunchy...
Working with psql directly in Postgres? These tips will help turn you into a psql power user -
Postgres Tips from the Experts at Crunchy Data
Advanced ideas and tricks on how to use Postgres to its best.
buff.ly
March 31, 2025 at 4:20 PM
Working with psql directly in Postgres? These tips will help turn you into a psql power user -
Need to get data to or from Postgres and into Parquet? pg_parquet is an open source extension that makes this easy, no need for complicated ETL processes -
pg_parquet: An Extension to Connect Postgres and Parquet | Crunchy Data Blog
Crunchy Data is excited to release a new extension so you can write Postgres data to Parquet and or pull data from Parquet to Postgres. Craig has the details and sample code.
buff.ly
March 27, 2025 at 5:03 PM
Need to get data to or from Postgres and into Parquet? pg_parquet is an open source extension that makes this easy, no need for complicated ETL processes -
We talk with users every week about whether Citus is a good fit for them. While Citus is a very powerful Postgres extension it has very specific use cases where it does fit, here we break down the cases where Citus is a fit as well as when it's not -
Citus: The Misunderstood Postgres Extension | Crunchy Data Blog
What applications and use cases make the most sense for Citus.
buff.ly
March 26, 2025 at 4:20 PM
We talk with users every week about whether Citus is a good fit for them. While Citus is a very powerful Postgres extension it has very specific use cases where it does fit, here we break down the cases where Citus is a fit as well as when it's not -
When it comes to developer tools everyone has their favorite tips and tricks. And because we love Postgres we worked to capture many of our favorite tips and tricks for Postgres here in this collection -
Postgres Tips from the Experts at Crunchy Data
Advanced ideas and tricks on how to use Postgres to its best.
buff.ly
March 25, 2025 at 4:20 PM
When it comes to developer tools everyone has their favorite tips and tricks. And because we love Postgres we worked to capture many of our favorite tips and tricks for Postgres here in this collection -
Excited to announce built-in maintenance for Iceberg via Postgres.
Now within Crunchy Data Warehouse we will automatically vacuum and continuously optimize your Iceberg data by compacting and cleaning up files.
Dig into the details of how this works www.crunchydata.com/blog/automat...
Now within Crunchy Data Warehouse we will automatically vacuum and continuously optimize your Iceberg data by compacting and cleaning up files.
Dig into the details of how this works www.crunchydata.com/blog/automat...
Automatic Iceberg Maintenance Within Postgres | Crunchy Data Blog
Iceberg can create orphan files during snapshot changes or transaction rollbacks. Crunchy Data Warehouse automatically cleans up the orphan files using a new autovacuum feature.
www.crunchydata.com
March 20, 2025 at 3:46 PM
Excited to announce built-in maintenance for Iceberg via Postgres.
Now within Crunchy Data Warehouse we will automatically vacuum and continuously optimize your Iceberg data by compacting and cleaning up files.
Dig into the details of how this works www.crunchydata.com/blog/automat...
Now within Crunchy Data Warehouse we will automatically vacuum and continuously optimize your Iceberg data by compacting and cleaning up files.
Dig into the details of how this works www.crunchydata.com/blog/automat...
Citus is a Postgres extension that turns it into a sharded, distributed, horizontally scalable database. With all these buzzwords, it attracts a lot of people thinking it can solve all their problems. We dig into when it is a good fit and when it isn't - www.crunchydata.com/blog/citus-t...
Citus: The Misunderstood Postgres Extension | Crunchy Data Blog
What applications and use cases make the most sense for Citus.
www.crunchydata.com
March 18, 2025 at 2:13 PM
Citus is a Postgres extension that turns it into a sharded, distributed, horizontally scalable database. With all these buzzwords, it attracts a lot of people thinking it can solve all their problems. We dig into when it is a good fit and when it isn't - www.crunchydata.com/blog/citus-t...
Happy pi day! 🥧
Postgres has a pi function: pi();
This can be used to calculate circular sizes and areas.
@pwramsey.bsky.social looks at pi in PostGIS today with a blog post on circular forms on PostGIS with a proof for the CIRCLELINESTRING shape.
www.crunchydata.com/blog/postgis...
Postgres has a pi function: pi();
This can be used to calculate circular sizes and areas.
@pwramsey.bsky.social looks at pi in PostGIS today with a blog post on circular forms on PostGIS with a proof for the CIRCLELINESTRING shape.
www.crunchydata.com/blog/postgis...
Pi Day PostGIS Circles | Crunchy Data Blog
For a proper Pi Day celebration in Postgres, Paul shows off a proof for CIRCULARSTRING.
www.crunchydata.com
March 14, 2025 at 3:35 PM
Happy pi day! 🥧
Postgres has a pi function: pi();
This can be used to calculate circular sizes and areas.
@pwramsey.bsky.social looks at pi in PostGIS today with a blog post on circular forms on PostGIS with a proof for the CIRCLELINESTRING shape.
www.crunchydata.com/blog/postgis...
Postgres has a pi function: pi();
This can be used to calculate circular sizes and areas.
@pwramsey.bsky.social looks at pi in PostGIS today with a blog post on circular forms on PostGIS with a proof for the CIRCLELINESTRING shape.
www.crunchydata.com/blog/postgis...
SQL output can be messy. Psql options for formatting output. A handy option is
\pset border 2
This will add top and bottom borders with double lines (╔, ╚, ╤, ╧, etc.). A Header row bordered with a double-line separator . Each row is separated by single lines. Each column is clearly separated.
\pset border 2
This will add top and bottom borders with double lines (╔, ╚, ╤, ╧, etc.). A Header row bordered with a double-line separator . Each row is separated by single lines. Each column is clearly separated.
January 21, 2025 at 3:56 PM
SQL output can be messy. Psql options for formatting output. A handy option is
\pset border 2
This will add top and bottom borders with double lines (╔, ╚, ╤, ╧, etc.). A Header row bordered with a double-line separator . Each row is separated by single lines. Each column is clearly separated.
\pset border 2
This will add top and bottom borders with double lines (╔, ╚, ╤, ╧, etc.). A Header row bordered with a double-line separator . Each row is separated by single lines. Each column is clearly separated.
Congratulations to the Postgres community on PostgreSQL once again being named the DBMS of the year in 2024, for the second year in a row. db-engines.com/en/blog_post...
PostgreSQL is the Database Management System of the Year 2024
db-engines.com
January 14, 2025 at 1:54 PM
Congratulations to the Postgres community on PostgreSQL once again being named the DBMS of the year in 2024, for the second year in a row. db-engines.com/en/blog_post...
Reposted by Crunchy Data
Great to see this ability for "creating processing pipelines for append-only streams of data...We believe it is a foundational building block for building IoT applications on PostgreSQL that should be available to everyone, similar to pg_cron, pg_parquet, and pg_partman."
We’re excited to release pg_incremental today - a new extension for automated incremental updates. pg_incremental is like a supercharged pg_cron that runs data pipelines, data syncs, rollups, imports and exports.
www.crunchydata.com/blog/pg_incr...
www.crunchydata.com/blog/pg_incr...
pg_incremental: Incremental Data Processing in Postgres | Crunchy Data Blog
We are excited to release a new open source extension called pg_incremental. pg_incremental works with pg_cron to do incremental batch processing for data aggregations, data transformations, or import...
www.crunchydata.com
January 2, 2025 at 9:48 AM
Great to see this ability for "creating processing pipelines for append-only streams of data...We believe it is a foundational building block for building IoT applications on PostgreSQL that should be available to everyone, similar to pg_cron, pg_parquet, and pg_partman."
Reposted by Crunchy Data
There are many incremental processing solutions, but they seem to never quite do what I need.
I decided to build an extension that just keeps running the same command in Postgres with different parameters to do fast, reliable incremental data processing.
That's pg_incremental.
1/n
I decided to build an extension that just keeps running the same command in Postgres with different parameters to do fast, reliable incremental data processing.
That's pg_incremental.
1/n
We’re excited to release pg_incremental today - a new extension for automated incremental updates. pg_incremental is like a supercharged pg_cron that runs data pipelines, data syncs, rollups, imports and exports.
www.crunchydata.com/blog/pg_incr...
www.crunchydata.com/blog/pg_incr...
pg_incremental: Incremental Data Processing in Postgres | Crunchy Data Blog
We are excited to release a new open source extension called pg_incremental. pg_incremental works with pg_cron to do incremental batch processing for data aggregations, data transformations, or import...
www.crunchydata.com
December 17, 2024 at 5:10 PM
There are many incremental processing solutions, but they seem to never quite do what I need.
I decided to build an extension that just keeps running the same command in Postgres with different parameters to do fast, reliable incremental data processing.
That's pg_incremental.
1/n
I decided to build an extension that just keeps running the same command in Postgres with different parameters to do fast, reliable incremental data processing.
That's pg_incremental.
1/n
We’re excited to release pg_incremental today - a new extension for automated incremental updates. pg_incremental is like a supercharged pg_cron that runs data pipelines, data syncs, rollups, imports and exports.
www.crunchydata.com/blog/pg_incr...
www.crunchydata.com/blog/pg_incr...
pg_incremental: Incremental Data Processing in Postgres | Crunchy Data Blog
We are excited to release a new open source extension called pg_incremental. pg_incremental works with pg_cron to do incremental batch processing for data aggregations, data transformations, or import...
www.crunchydata.com
December 17, 2024 at 4:39 PM
We’re excited to release pg_incremental today - a new extension for automated incremental updates. pg_incremental is like a supercharged pg_cron that runs data pipelines, data syncs, rollups, imports and exports.
www.crunchydata.com/blog/pg_incr...
www.crunchydata.com/blog/pg_incr...
Many big Postgres databases today use partitioning. Do you have a default partition? If not, you probably should. Default partitions are super important because they let you catch inconsistent data or bugs in your application code.
www.crunchydata.com/blog/postgre...
www.crunchydata.com/blog/postgre...
Postgres Partitioning with a Default Partition | Crunchy Data Blog
Keith discusses the importance of having a default partition, how to monitor the default, and how to move rows to new child tables.
www.crunchydata.com
December 6, 2024 at 4:47 PM
Many big Postgres databases today use partitioning. Do you have a default partition? If not, you probably should. Default partitions are super important because they let you catch inconsistent data or bugs in your application code.
www.crunchydata.com/blog/postgre...
www.crunchydata.com/blog/postgre...
We have been talking to customers a lot about the medallion architecture with data. This is a pattern we see for data lakehouses.
December 3, 2024 at 7:39 PM
We have been talking to customers a lot about the medallion architecture with data. This is a pattern we see for data lakehouses.
Reposted by Crunchy Data
Did you miss PostGIS day this year? If you did don't worry, you don't have to entirely miss out, we've got your recap and the videos for you here - www.crunchydata.com/blog/postgis...
PostGIS Day 2024 Summary | Crunchy Data Blog
Crunchy Data hosted an online event for PostGIS on November 21st, 2024. Paul has a wrap up post discussing the highlights and themes throughout the day.
www.crunchydata.com
November 27, 2024 at 8:16 PM
Did you miss PostGIS day this year? If you did don't worry, you don't have to entirely miss out, we've got your recap and the videos for you here - www.crunchydata.com/blog/postgis...
Running queries on data that have nulls in them? Make your data more clear by specifying a special character for null with psql:
\pset null 👻
\pset null 👻
November 27, 2024 at 6:00 PM
Running queries on data that have nulls in them? Make your data more clear by specifying a special character for null with psql:
\pset null 👻
\pset null 👻