Why doesn't your PostgreSQL database just keep getting bigger and bigger after every UPDATE?

And what's this "TXID wraparound" thing that can literally shut your database down? 🤯

The answer to both is a single, crucial process: VACUUM.

Let's dive in. 🧵👇

1/7

Working with data is not centering divs on a webpage.

(No offense to my frontend colleagues.) 🧵👇

1/7

Who should have more control over your database: You, or your cloud provider?

I was happy to see Thoughtworks put CloudNativePG on 'Assess' in their new Tech Radar. Why? 🧵👇

1/6

Everyone is talking about LLMs. Nobody is talking about the standardization nightmare.

With every new model, the chaos grows. How do you build a system you can actually trust? 🧵👇

Ever wondered what happens when you INSERT a row?

It doesn’t land in one big file. In PostgreSQL, tables are made of 8KB pages (can be changed) tiny, highly organized storage units.

Let’s dive into the Database Page Layout. 🧵👇

Was watching CMU Intro to Database Systems Lecture #01, loved the question from prof. Andy Pavlo …

> „What databases do you know?”
> PostgreSQL, MySQL, Oracle, SQLite

Database vs Database Management System classic :D

Not that it matters in reality but still.

How can we ensure operational integrity and consistency in database systems?

E.g. bank transactions between two accounts; a failure during the process could lead to discrepancies.

👉 Transactions
👉 ACID
👉 Isolation Levels

Check out my new video: www.youtube.com/watch?v=mL2...

"What has been the most surprising impact of blogging for you?

That it is a fundamental carrier for software projects. You can't have a successful project most of the time without communicating it. "

Amen to that!

Winter ❄️ hack after heavy snowfall.

Go for a run and then shovel the snow. Thanks to endorphins after a run, you will be less upset about needing to shovel and you will add strength training to cardio.

You're welcome 😉

Dealing with duplicates in data? Let's fix that but first ...

Duplicates are rows that are identical in value to other rows in the same table or result set. 

Common Causes of Duplicates
👉 Flawed database model
👉 Incorrect table joining conditions
👉 Manual data entry errors

SQL CAST Exceptions causing trouble? 🤔 Learn how to handle invalid type conversions in plain SQL with regex, CTEs, and database-specific functions like IS_UUID or TRY_CONVERT.💡Watch the full breakdown here: youtu.be/Kx1z_vz9opA 🎥
#sql #datacraze #dataengineering #database

Creating content (specifically videos) in a way that it's clear and brings value for your audience but it's not bloody long is a form of art :D

Doing my best but still have a ton to learn to divide the final recording time by half :D

Get the fundamentals right … that’s something that is constantly getting back to me.

Applicable for both IT and life care for fundamentals - ex. diet, exercise, sleep, algorithms - even if you don’t think they are crucial for your day job / current priorities.

🔍 SQL CAST throwing error?

Three ways to handle it SQL:
- Using regex validation
- Leveraging built-in functions (IS_UUID, TRY_CONVERT)
- Creating custom validation functions

Plus: Key questions to ask before implementing these solutions!

More in the blog post: datacraze.io/sql-cast-exc...

Something I’ve started doing this year.

Writing letters to my children, wife and myself. I write them for the recipient's birthday.

At least for me it is easier to share my feelings and thoughts “on paper”.

Try it out maybe it will suit you.

Hubert 'depesz' Lubaczewski great person in Databases, SQL, and specifically PostgreSQL world.

"Waiting for ..." cycles or EXPLAIN tool for SQL pure gold check out his work at depesz.com

Not sponsored by any means just personal thanks for a ton of great content.