Delta Lake
@deltalakeoss.bsky.social
39 followers 6 following 120 posts
Delta Lake is an open-source storage framework that enables building a Lakehouse architecture for Spark, Flink, Trino, Hive, Scala, Java, Rust, Python, & more.
Posts Media Videos Starter Packs
deltalakeoss.bsky.social
One of the most powerful new capabilities in Delta Lake 4.0 is support for collations, giving you much finer control over how text is compared and sorted. ✅

In this clip, Youssef Mrini explains how to enable collations.

🎥 Watch the full webinar: youtube.com/live/0BfUG2PZyNs?si=nzcalgk1gvOEFBrY
deltalakeoss.bsky.social
One week to go! 🥳 Curious how data engineering design patterns translate to Delta Lake, & how it fits into streaming architectures?

Join us for a walkthrough of the patterns, features, & best practices powering reliable streaming with #DeltaLake.

🗓️ Oct 14
🕝 9AM PT
🔗 RSVP: luma.com/delta-1014

#oss
Diving into Streaming Data Design Patterns for Delta Lake · Luma
Are you wondering if general concepts like data engineering design patterns can help you learn about Delta Lake? Or, if it's possible to leverage Delta Lake…
luma.com
deltalakeoss.bsky.social
Tomorrow, Oct 7 at 9AM PT! Join Ciro Greco & Jacopo Tagliabue from bauplan for a live webinar on how function-based execution & Git-for-Data are reshaping lakehouses for autonomous AI agents. ✅

Don’t miss the future of agentic data ops!

Secure your spot ➡️ luma.com/OLAI-107

#opensource #lakehouse
From Functions to AI Agents: Reimagining the Lakehouse for an Agentic Future · Zoom · Luma
The lakehouse promises a unified platform for analytics, ML, and governance. While modern catalogs offer unified governance, the same uniformity is still…
luma.com
deltalakeoss.bsky.social
🎥 Explore a detailed walk-through and the expanded feature set of Delta 4 in this webinar: www.youtube.com/live/0BfUG2P...

#opensource #oss #deltalake #JVM #spark #rust #go
Delta Lake is Growing Up: Diving into Our Favorite Features of Delta 4.0
YouTube video by Delta Lake
www.youtube.com
deltalakeoss.bsky.social
Delta Connect is a plugin atop Spark Connect, introduced in Spark 3.4, and enables gRPC communication using Protocol Buffers. ✅ This allows client implementations in languages such as Rust and Go to interact with Spark outside the JVM, provided they support the protocol.

#opensource #oss #deltalake
deltalakeoss.bsky.social
🔹 Oct 7: Webinar — From Functions to AI Agents: Reimagining the Lakehouse for an Agentic Future
🔹 Nov 13: Mini Summit | Mountain View, CA
🔹 Nov 24: Open Lakehouse + AI | Paris, France

Secure your spot: register now on Luma! 🔗 luma.com/open-lakehouse

#openlakehouse #oss #opensource #deltalake #ai
deltalakeoss.bsky.social
At Open Lakehouse + AI Amsterdam last month, Sammy Sidhu—co-creator of the Daft multi-modal query engine and CEO of Eventual—shared how his open source journey began. 🚀

Ready to shape the future of data, open source, and AI together? Join us at our next Open Lakehouse + AI events! ⬇️

#opensource
deltalakeoss.bsky.social
🚀 Happening today, Sept 30 at 9AM PT!

Join us for a behind-the-scenes look at the Delta Rust Kernel with R. Tyler Croy, Robert Pack, and Scott Haines. Discover how #DeltaLake’s core is evolving with powerful new features like column mapping and deletion vectors.

👉 Register now: luma.com/delta-0930
Exploring Delta's Rust Kernel: A behind the scenes exploration of what secretly powers delta-rs · Luma
The Delta Lake ecosystem has evolved significantly since 2021, becoming more complex while facing fragmentation challenges across different engine…
luma.com
deltalakeoss.bsky.social
🚨 Happening tomorrow!

Get an inside look at how the new Delta Rust kernel is transforming Delta Lake. Learn how it solves fragmentation, enables column mapping & deletion vectors, and why it matters—even if you don’t touch the kernel.

Register ➡️ luma.com/delta-0930

#opensource #deltalake #oss
Exploring Delta's Rust Kernel: A behind the scenes exploration of what secretly powers delta-rs · Luma
The Delta Lake ecosystem has evolved significantly since 2021, becoming more complex while facing fragmentation challenges across different engine…
luma.com
deltalakeoss.bsky.social
Join us at our next Open Lakehouse + AI events!
🔹 Oct 7: Webinar — From Functions to AI Agents: Reimagining the Lakehouse for an Agentic Future
🔹 Nov 13: Mini Summit | Mountain View, CA
🔹 Nov 24: Open Lakehouse + AI | Paris, France

Register now on Luma! 🔗 luma.com/open-lakehouse

#ai #opensource
Open Lakehouse + AI · Events Calendar
View and subscribe to events from Open Lakehouse + AI on Luma.
luma.com
deltalakeoss.bsky.social
“Open source is giving back, because it means everyone who supports our work can participate and benefit from the software we are making." — @hannes.muehleisen.org (@duckdb.org) at Open Lakehouse + AI Amsterdam 🇳🇱

Ready to shape the future of data, open source, and AI together? ⬇️

#opensource #oss
deltalakeoss.bsky.social
Dropping features in #DeltaLake used to break table compatibility and history. Delta 4.0 fixes this by protecting checkpoints and rewriting recent history—keeping tables safe and stable. 💪

🎥 Watch the full webinar replay: www.youtube.com/watch?v=0BfU...

#opensource #oss
deltalakeoss.bsky.social
Delta Lake has evolved—fragmentation is out, the new Rust kernel is in. 🚀 Join R. Tyler Croy, Robert Pack & Scott Haines to explore fixes to past issues, new features (column mapping + deletion vectors), and why it matters.

📅 Sept 30
🕜 9AM PT
🔗 Register: luma.com/delta-0930

#DeltaLake #Rust #OSS
Exploring Delta's Rust Kernel: A behind the scenes exploration of what secretly powers delta-rs · Luma
The Delta Lake ecosystem has evolved significantly since 2021, becoming more complex while facing fragmentation challenges across different engine…
luma.com
deltalakeoss.bsky.social
Scott Haines & Youssef Mrini will dive into:
🔹 Variant Type support
🔹 Type-Widening
🔹 Collated Columns
🔹 Delta Connect

Plus, they’ll revisit clustering strategies with Liquid Clustering.

See you soon! 🌟
deltalakeoss.bsky.social
Missed the Delta Live! Rust hacking sessions with R. Tyler Croy and Robert Pack? 🤔

Catch up on the action as they dive into Rust development for Delta Lake, showcasing real-time coding, debugging, and problem-solving.

🎥 Watch here: youtube.com/playlist?lis...

#opensource #deltalake #livehacking
Delta Lake Live! - YouTube
youtube.com
deltalakeoss.bsky.social
The countdown is on—our Delta 4.0 webinar is next week! 🚀

Join Youssef Mrini and Scott Haines as they explore the powerful new features in Delta 4.0 that can transform how you design and optimize data workflows.

🗓️ Tuesday, Sept 16
🕝 9:00AM PT
🔗 Save your spot: luma.com/delta-0923

#oss #deltalake
Delta Lake is Growing Up: Diving into Our Favorite Features of Delta 4.0 · Luma
Delta 4.0 is here and we’re really excited to share our favorite new features with you. In this session, join Youssef Mrini and Scott Haines as they walk you…
luma.com
deltalakeoss.bsky.social
Upcoming Webinar ➡️ Exploring Delta’s Rust Kernel: a look behind the scenes at what powers delta-rs!

Join R. Tyler Croy, Robert Pack & Scott Haines to learn how kernel changes deliver consistency, new features & faster performance for Delta engines.

📅 Sept 30 @ 9AM PT
🔗 RSVP: luma.com/delta-0930
deltalakeoss.bsky.social
📣 Mark your calendar for Tuesday, October 7 at 9AM PT for the next Open Lakehouse + AI webinar: “From Functions to AI Agents: Reimagining the Lakehouse for an Agentic Future!” 🚀

🔗 Register here: luma.com/OLAI-107

#opensource #deltalake #agentic #aiagents #oss
deltalakeoss.bsky.social
Excited to announce Delta Live! Live Rust Hacking and AMA — streaming tomorrow, Sept 9 on Twitch. 👏

Join R. Tyler Croy and Robert Pack for a hands-on Rust session and live Q&A!

📅 Sept 9
⏰ 7AM PT / 10AM ET
🔗 twitch.tv/agentdero

Bring your questions and gain insights from #DeltaLake maintainers. 🦀
deltalakeoss.bsky.social
Delta 4.0 brings powerful new features that can reshape how you design and optimize your data workflows. 🚀 Join Youssef Mrini & Scott Haines as they break down their favorite features!

🗓️ Tuesday, Sept 16
🕝 9:00 AM PT
🔗 RSVP: luma.com/delta-0923

#opensource #oss #deltalake #linuxfoundation
Delta Lake is Growing Up: Diving into Our Favorite Features of Delta 4.0 · Luma
Delta 4.0 is here and we’re really excited to share our favorite new features with you. In this session, join Youssef Mrini and Scott Haines as they walk you…
luma.com
deltalakeoss.bsky.social
🗓️ More meetups are on the way!
Subscribe to the Open Lakehouse + AI Luma page to stay up-to-date on future #OpenLakehouse events. ➡️ luma.com/open-lakehouse

#opensource #oss #deltalake #lakehouse
Open Lakehouse + AI · Events Calendar
View and subscribe to events from Open Lakehouse + AI on Luma.
luma.com
deltalakeoss.bsky.social
Attendees connected over innovative talks by Chang She (LanceDB), Sammy Sidhu (Daft), @hannes.muehleisen.org (DuckDB), Ion Koutsouris & Robert Pack (Databricks), with conversations centered on open source collaboration and a shared vision for interoperable lakehouse systems.
deltalakeoss.bsky.social
The first-ever Open Lakehouse + AI Meetup in Amsterdam was a huge success! 🙌🇳🇱

The evening brought together the open source and data engineering community to explore the latest advancements in open lakehouse and AI architectures. 🚀
deltalakeoss.bsky.social
🚨 Happening TODAY, August 26 at 7AM PT!

Join R. Tyler Croy (Buoyant Data) & Robert Pack (Databricks) for live Rust hacking and get answers to all your #DeltaLake questions — streaming LIVE on Twitch!

🎥 Tune in: www.twitch.tv/agentdero

#rustlang #rust #kernel