Lightnews — Scholar-powered news

Reposted by The Streaming Otter

Yennick Trevels @digitalbuff.dev · 20d

🚀 Announcing the Kafka Streams Field Guide! I’m writing a book with 8 insights for running Kafka Streams in production. Join the waiting list at kafkastreamsfieldguide.com and get 2 free chapters! #ApacheKafka

Kafka Streams Field Guide | Kafka Streams Field Guide Book

kafkastreamsfieldguide.com

1 1 1

The Streaming Otter @thestreamingotter.bsky.social · 5d

taogang.medium.com/the-past-and...

The Past and Present of Stream Processing (Part 13): Kafka Streams — A Lean and Agile King’s Army

Introduction

taogang.medium.com

3 3

Reposted by The Streaming Otter

Matthias J. Sax @mjsax.bsky.social · 6d

Happy to share, that we did release an update to our @kafkastreams.bsky.social UI in #ConfluentCloud.

We are now showing more detailed information about instances, threads, running/rebalancing state, and JMX metrics.

Check it out and let us know what you think!

www.confluent.io/blog/monitor...

Monitor Kafka Streams Health in Confluent Cloud

Quickly troubleshoot Kafka Streams apps with new health metrics in Confluent Cloud. Spot bottlenecks, monitor RocksDB, and reduce MTTR—no extra code.

www.confluent.io

5 4

Reposted by The Streaming Otter

Kafka Streams @kafkastreams.bsky.social · 6d

We are excited to announce the Apache Kafka 4.0.1 bug-fix release, containing over 40 fixes!

Thanks to 53 contributors and your RM Christo Lolov.

For more details, checkout the announcement:
kafka.apache.org/blog#apache_...

Apache Kafka

Apache Kafka: A Distributed Streaming Platform.

kafka.apache.org

4 5

The Streaming Otter @thestreamingotter.bsky.social · 12d

Oh-oh!

Kafka Streams @kafkastreams.bsky.social · 14d

🚨Kafka Streams 4.1.0 contains a memory leak regression bug: issues.apache.org/jira/browse/...

Be careful upgrading, or wait for 4.1.1 bug-fix release. We plan to get it out quickly.

issues.apache.org

Reposted by The Streaming Otter

Kafka Streams @kafkastreams.bsky.social · 20d

Any KIP-1071 experience out there?

Asking for a friend.

3 2

Reposted by The Streaming Otter

Restate @restate.dev · 19d

🚀 Yesterday, we announced that 𝗥𝗲𝘀𝘁𝗮𝘁𝗲 𝗖𝗹𝗼𝘂𝗱 is now publicly available. Today, we’re announcing 𝗥𝗲𝘀𝘁𝗮𝘁𝗲 𝟭.𝟱!

This release brings key features for building, controlling and observing your durable agents and workflows.

1 2 7

Reposted by The Streaming Otter

Matthias J. Sax @mjsax.bsky.social · Sep 10

The #ApacheKafka Java clients and #KafkaStreams engineering team at @confluent.io keeps growing.

Very excited to welcome @okaberintaroubeta.bsky.social, Genseric Ghiro, and @nikitashupletsov.bsky.social!

We also have one more entry level position in Toronto 🇨🇦

careers.confluent.io/jobs/job/67c...

careers.confluent.io

2 2

The Streaming Otter @thestreamingotter.bsky.social · Sep 10

😢

www.responsive.dev/ks-archive

Responsive | Kafka Streams Vault

We're no longer actively developing or maintaining our Kafka Streams content. Visit our GitHub repository for archived blog content.

www.responsive.dev

3

Reposted by The Streaming Otter

Kafka Streams @kafkastreams.bsky.social · Sep 4

Apache Kafka 4.1.0 was release!

Most exciting, the new “streams” rebalance protocol is available as early access.

We are happy to announce the Apache Kafka 4.1.0 release!

Please try it out, and let us know how it goes!

kafka.apache.org/blog#apache_...

Apache Kafka

Apache Kafka: A Distributed Streaming Platform.

kafka.apache.org

4 5

Reposted by The Streaming Otter

Kafka Streams @kafkastreams.bsky.social · Jul 28

While we are waiting for Apache Kafka 4.1.0 release, the development does not stop. We just completed KIP-1034 (cwiki.apache.org/confluence/d...) which adds a DLQ feature to Kafka Streams. Very exciting!

https://cwiki.apache.org/confluence/dis…

4 3

Reposted by The Streaming Otter

Apache Software Foundation (The ASF) @apache.org · Jun 17

The schedule is now available for Community Over Code North America, and early bird registration ends June 28. We hope you'll join the ASF community in Minneapolis Sept 11-14! buff.ly/4b8kciW

#CommunityOverCode #opensource

2 4

Reposted by The Streaming Otter

Chris @chris.blue · Jun 18

Insane amount of SlateDB work going on:

- snapshot reads
- split/merge DBs (zero copy)
- deterministic simulation testing

And someone just pushed Python bindings in a PR! 🤯

3 9

Reposted by The Streaming Otter

Apache Software Foundation (The ASF) @apache.org · Jun 10

Apache Kafka 3.9.1 is now available for download: buff.ly/5ONjJgB

This bug-fix release has several fixes, and most importantly, it adds Java 23 support. #opensource

5 8

Reposted by The Streaming Otter

Tom Cooper @tomcooper.dev · May 20

Next at #Current25 a panel discussion on the past, present and future of @kafkastreams.bsky.social. I love the background...the likeness is uncanny...

2 6

Reposted by The Streaming Otter

Matthias J. Sax @mjsax.bsky.social · Apr 22

New blog post alert! My colleague Alieh Saeedi digs into the guts of manual consumer offset commits, and the improvements of KIP-1094 (AK 4.0) about it.

Outstanding work!

Enjoy the read and change your code. You most likely do it wrong right now!

www.confluent.io/blog/guide-t...

Kafka Consumer Offsets Guide—Basic Principles, Insights & Enhancements

Learn how to achieve data consistency and reliability with a complete Apache Kafka consumer offsets guide covering key principles, offset management, and KIP-1094 innovations.

www.confluent.io

2 3

Reposted by The Streaming Otter

Chris @chris.blue · Apr 22

Today marks SlateDB’s one year anniversary! It’s been a lot of fun. Thanks to @rohanpd.bsky.social @flaneur2024.bsky.social @almog.ai @vigneshc.bsky.social @paulbutler.org Jason Gustafson, David Moravek, and many others for joining the project. 😀

SlateDB - An embedded storage engine built on object storage | SlateDB

Description will go into a meta tag in <head />

SlateDB.io

5 16

Reposted by The Streaming Otter

Matthias J. Sax @mjsax.bsky.social · Apr 23

We are having two more (early career) open positions in our team, Java clients & #KafkaStreams (🇨🇦). If working on distributed data systems and stream processing sounds interesting to you, please apply: careers.confluent.io/jobs/1518441...

We have also not closed the other two positions yet:

3 8

Reposted by The Streaming Otter

Neil Buesing @nbuesing.bsky.social · Apr 22

Looking forward to @sharatchander.bsky.social 's Keynote. Then, looking forward to hearing @gamussa.dev talking about Kafka and the Schema Registry, and then more!

Java, Kafka, @kafkastreams.bsky.social, & @intellijidea.com - that's my tech stack!

lp.jetbrains.com/intellij-ide...

@jetbrains.com

IntelliJ IDEA Conf 2025 | June 3-4, 2025

We invite you to join us for IntelliJ IDEA Conf 2025 and gain insights from industry leaders and experts.

lp.jetbrains.com

2 5

Reposted by The Streaming Otter

Kafka Streams @kafkastreams.bsky.social · Apr 5

Apache Kafka 4.0 was released recently. We got a couple of a cool KIPs shipped.

KIP-1065: cwiki.apache.org/confluence/p...

The ProductionExceptionHandler becomes more flexible. It’s now also called for retriable errors. This allows you to break (previously infinite) retry loops.

\1

https://cwiki.apache.org/confluence/pag…

1 1 1

The Streaming Otter @thestreamingotter.bsky.social · Mar 29

Interesting.

www.kafkastreams.money

Kafka Streams Cost Calculator | Estimate Your Kafka Streams Application Costs

Free tool to analyze and estimate the costs of running Kafka Streams applications. Calculate compute, storage, and operational costs for your Kafka Streams deployment.

www.kafkastreams.money

1 5

Reposted by The Streaming Otter

Matthias J. Sax @mjsax.bsky.social · Mar 28

We have two open (early career) engineering positions in our team (Canada 🇨🇦)

If you are excited about contributing to #ApacheKafka with a focus on Java client and @kafkastreams.bsky.social this might be the right fit for you

careers.confluent.io/jobs/1581205...
careers.confluent.io/jobs/1580808...

6 9

Reposted by The Streaming Otter

Marie-Laure Momplot @malainda.bsky.social · Mar 21

Thrilled to announce that I'll be bringing my 'charming French accent' to #Current25 London to present my talk: 'Massive Kafka Streams Topology Revamp in Production: No Chaos, No Headaches! My Key Takeaways 🦾'. Can’t wait to share the lessons learned! #kafka #eda #kafkaStreams #kstreamplify

1 2 7

Reposted by The Streaming Otter

Sébastien Viale @sebviale.bsky.social · Mar 26

First time at #Current2025, and I’m incredibly lucky to have been selected as a speaker for two talks!

🔹 Optimizing Kafka Streams Joins, with @adamsouquieres.bsky.social
🔹 Exception Handling & DLQ in Kafka Streams – A deep dive into KIP-1033 & KIP-1034

Can’t wait to meet the #Kafka community!

1 3 6

Reposted by The Streaming Otter

Matthias J. Sax @mjsax.bsky.social · Mar 27

Drum roll... 🥁

We released our Confluent Cloud UI for #KafkaStreams

Instead of only seeing the internal consumer/producer clients in the "Clients" view, you now get a list of all your running #KafkaStreams applications, plus some basic statistics.

--Long live the otter. 🦦

1 1 2