pmbrull
pmbrull.bsky.social
pmbrull
@pmbrull.bsky.social
OpenMetadata | Founding Engineer @ Collate | I try to write about (meta)data and programming while fencing with a couple of cats and an empty cup of coffee

http://pmbrull.me
Release time is stressful, but seeing all the hard work paying off is freaking awesome.

Lo que se conoce como dpm vaya

See you there!

www.meetup.com/openmetadata...
AI-powered Data Management: OpenMetadata 1.7 Release + Gorgias Success Story, Wed, Mar 19, 2025, 9:00 AM | Meetup
The OpenMetadata 1.7 Release Community Meeting is here! We're excited to showcase our brand-new user experience and operational workflows, especially when it comes to getti
www.meetup.com
March 18, 2025 at 10:32 AM
There are so many features you can exploit once metadata reaches the platform. The fun starts once the metadata is ingested.
March 7, 2025 at 1:14 PM
You can actually activate your metadata by handling any runtime exceptions and push the pipeline status in OM as well to keep tabs on your executions and even hook it up with OM's observability system to receive alerts when pipelines fail.
March 7, 2025 at 1:14 PM
Now, a follow-up question would be "all this just to document"?

We're not only talking about the importance of centralizing information, sharing context, enabling lineage, root-cause analysis,...
March 7, 2025 at 1:14 PM
2. We also understand that for in-house systems, there might not be a solution already built. You can leverage the Python SDK to push pipeline and lineage information at the time the ETL itself runs. This is a very flexible approach, and this same SDK is the one that powers all connectors.
March 7, 2025 at 1:14 PM
Might not be as marketing-y as clustering duckdb, but every company ends up having specific problems to solve, and we're doing an awesome job with ours.
March 5, 2025 at 10:47 AM
Is anyone happy with their oob migration solution? Well, we built our own to have complete control of the execution and even allow us to migrate data using Java code directly when SQL was falling short. We also built a profiling and DQ system from the ground up, an ingestion framework,...
March 5, 2025 at 10:47 AM