Danica Fine
@thedanicafine.bsky.social
2.1K followers 96 following 370 posts
Opinions my own. Developer Advocate. 🥑 ❄️ http://linktr.ee/thedanicafine
Posts Media Videos Starter Packs
Pinned
thedanicafine.bsky.social
Since we're kicking things off around here, again, I may as well find the rest of my fellow Kafka fans:

It's rough out there. Know the signs. Know what your loved ones are saying about #apacheKafka.
thedanicafine.bsky.social
Or listen along with my latest release video:
🎬 youtu.be/7BLoAkrA-h4
thedanicafine.bsky.social
#ICYMI, #apacheIceberg ™ 1.10 landed yesterday!

Looking to stay up to date on the latest features included as part of the release? I teamed up with Steven Wu to bring you a list of some of the most impactful features in 1.10. Check it out!
📚 www.snowflake.com/en/engineeri...
Apache Iceberg™ 1.10: New Features, Fixes & What's Next for Data Lakes
Apache Iceberg 1.10 is here! Discover the key features, bug fixes, and spec updates in this new release, including support for Flink 2.0 and Spark 4.0, BigQuery integration, and core performance impro...
www.snowflake.com
thedanicafine.bsky.social
There's still time to RSVP for tonight's #apachePolaris (incubating) meetup in the #Seattle / #Bellevue area!

We have an incredible line up of speakers tonight––don't miss your chance to connect with them, get up to speed on the project, and join in on building out Polaris!
luma.com/s8tik7g0
Apache Polaris™ (incubating) Meetup Seattle · Luma
Seattle Apache Polaris™ (incubating) Meetup! Join us on September 9th (Tuesday) from 5:00-8:30 PM at the Snowflake Bellevue Office. Connect with fellow…
luma.com
thedanicafine.bsky.social
So good to meet you! Hope to see you again at another conference. 😁
thedanicafine.bsky.social
😂 Hope to catch you at my #apacheKafka <> #apacheIceberg session!
thedanicafine.bsky.social
Listen along and learn a bit more about how they efficiently solve this issue ⤵️
thedanicafine.bsky.social
I sat down with Roman Kolesnev and learned that Streambased is building out a product that solves this problem exactly! Allowing your #apacheKafka data to be indexed and available immediately (without copying) and queryable through databases, open table formats like #apacheIceberg, or file systems.
thedanicafine.bsky.social
But when the time comes to use your infinite data, how do you find the *right* data? #apacheKafka is a log. And even with smart partitioning, you still have to re-stream most of the data in order to find the specific account or key that you're looking for. 🔎
thedanicafine.bsky.social
🔙 Back Fill. Use the history of events to rebuild state in other applications/databases.
😰 Anxiety? You don't quite know what you'll do with that data now, but you might need it someday!
thedanicafine.bsky.social
📊 Time Travel Analytics. Having the entire history of data means you can easily go back to any time period and analyze those events for fraud, debugging, etc.
📑 Auditing and Regulatory. Certain industries/companies are required to retain data for a specific length of time
thedanicafine.bsky.social
Infinite storage in #apacheKafka is all the rage. But what exactly is your plan when you decide to keep years' worth of data in Kafka topics? 🤔

From what I've seen, folks opt in for infinite storage for a few reasons:
thedanicafine.bsky.social
I also had a chance to work with Yufei Gu, the Polaris 1.0 release manager, to put together a blog that highlights the most important parts of this release. 👇
www.snowflake.com/en/engineeri...
www.snowflake.com
thedanicafine.bsky.social
It's been a great week because the #apachePolaris (incubating) community just announced a milestone release with version 1.0!

Want to know what's included? You're in luck, because there's a release video for that! 📹
www.youtube.com/watch?v=ST8P...
thedanicafine.bsky.social
I'll consult your calendar for the next one! 😉
thedanicafine.bsky.social
Hello, #amsterdam-based #AI enthusiasts! Let's have a meetup!

On July 31, LlamaIndex and Snowflake are coming together to host folks for an evening of discussion around building effective data agents.

Register now to secure your slot! 🎟️
lu.ma/vzwsj72w
Snowflake + LlamaIndex Data Agent Builders Meetup Amsterdam · Luma
Join local AI engineers, data scientists, and builders for an evening of hands-on talks and open discussion around one challenge we all care about: building…
lu.ma
thedanicafine.bsky.social
We'll talk all things #apacheIceberg, #dataLakehouse, open table formats, and more. This is a great chance to connect with #openSource community members like @russellspitzer.bsky.social, stay up to data on what's new in the space, and learn more about the open lakehouse movement.
thedanicafine.bsky.social
📖 enjoy creating developer-focused content around #openSource #dataEngineering technologies (think #apacheIceberg, #postgres, #apacheNifi, and more)
🫂 love building, supporting, and championing the technical community
... then this just might be the role for you!
thedanicafine.bsky.social
If you...
🏛️ have experience with #openSource foundations (like the Apache Software Foundation, Linux Foundation, etc.)
⚙️ want the opportunity to work closely with and drive our evolving #OSPO
thedanicafine.bsky.social
Not convinced? Let's hear from Lester Martin, #starburst, on why else you should care and give #apacheNifi a try 👇
thedanicafine.bsky.social
What about from a #Snowflake perspective?

#apacheNifi is the foundation for Snowflake's data integration service, #openFlow. It's especially useful for multi-modal datasets that you might need for your #AI workflows.
docs.snowflake.com/en/user-guid...