Lightnews — Scholar-powered news

Kafka Streams @kafkastreams.bsky.social · 6d

We are excited to announce the Apache Kafka 4.0.1 bug-fix release, containing over 40 fixes!

Thanks to 53 contributors and your RM Christo Lolov.

For more details, checkout the announcement:
kafka.apache.org/blog#apache_...

Apache Kafka

Apache Kafka: A Distributed Streaming Platform.

kafka.apache.org

4 5

Kafka Streams @kafkastreams.bsky.social · 13d

🚨Kafka Streams 4.1.0 contains a memory leak regression bug: issues.apache.org/jira/browse/...

Be careful upgrading, or wait for 4.1.1 bug-fix release. We plan to get it out quickly.

issues.apache.org

Kafka Streams @kafkastreams.bsky.social · 20d

Any KIP-1071 experience out there?

Asking for a friend.

3 2

Reposted by Kafka Streams

Apache Software Foundation (The ASF) @apache.org · Sep 11

🚨 Breaking News from Community Over Code 🚨

Introducing The ASF’s New Logo buff.ly/DzgT82w

#CommunityOverCode #opensource

18 26

Kafka Streams @kafkastreams.bsky.social · Sep 4

Apache Kafka 4.1.0 was release!

Most exciting, the new “streams” rebalance protocol is available as early access.

We are happy to announce the Apache Kafka 4.1.0 release!

Please try it out, and let us know how it goes!

kafka.apache.org/blog#apache_...

Apache Kafka

Apache Kafka: A Distributed Streaming Platform.

kafka.apache.org

4 5

Kafka Streams @kafkastreams.bsky.social · Jul 28

While we are waiting for Apache Kafka 4.1.0 release, the development does not stop. We just completed KIP-1034 (cwiki.apache.org/confluence/d...) which adds a DLQ feature to Kafka Streams. Very exciting!

https://cwiki.apache.org/confluence/dis…

4 3

Reposted by Kafka Streams

Tom Cooper @tomcooper.dev · May 20

Next at #Current25 a panel discussion on the past, present and future of @kafkastreams.bsky.social. I love the background...the likeness is uncanny...

2 6

Reposted by Kafka Streams

Apache Software Foundation (The ASF) @apache.org · Jun 10

Apache Kafka 3.9.1 is now available for download: buff.ly/5ONjJgB

This bug-fix release has several fixes, and most importantly, it adds Java 23 support. #opensource

5 8

Kafka Streams @kafkastreams.bsky.social · Apr 5

There is a few more others which are more minor. So we stick with these highlights for now. If you want to know them all (also for older releases), check out the wiki: cwiki.apache.org/confluence/d...

That’s a wrap!

\TheEnd

https://cwiki.apache.org/confluence/dis…

1

Kafka Streams @kafkastreams.bsky.social · Apr 5

KIP-1112: cwiki.apache.org/confluence/d...

Injecting custom boiler plate code into all Processors is now easily possible, via this new “processor wrapper” concept. Useful for PAPI users, but invaluable for the DSL!

\6

https://cwiki.apache.org/confluence/dis…

1 1

Kafka Streams @kafkastreams.bsky.social · Apr 5

KIP-1106: cwiki.apache.org/confluence/d...

This is a shared KIP for the consumer and Kafka Streams. A new auto.offset.reset policy “by duration” is added. Very useful for tiered storage setups when you don’t want to use “earliest” but still want to start at some point in the past.

\5

https://cwiki.apache.org/confluence/dis…

1 1

Kafka Streams @kafkastreams.bsky.social · Apr 5

KIP-1104: cwiki.apache.org/confluence/d...

Foreign-key table-table joins are very popular. However, the FK could only be extracted from the value so far. This unnecessary limitation is gone now, by passing in both key and value into the FK-key extractor.

\4

https://cwiki.apache.org/confluence/dis…

1 1

Kafka Streams @kafkastreams.bsky.social · Apr 5

KIP-1091: cwiki.apache.org/confluence/d...

Let’s make KIP-1076 even more useful. A few key metrics like client-state and thread-state are Strings and thus cannot be collected via KIP-714. This KIP adds numerical twins for these metrics to make them collectible!

\3

https://cwiki.apache.org/confluence/dis…

1 1

Kafka Streams @kafkastreams.bsky.social · Apr 5

KIP-1076: cwiki.apache.org/confluence/d...

This is an extension to the famous KIP-714. We now allow to register user metrics for broker side collection. Kafka Streams uses these new APIs to register its own metrics, so all Kafka Streams metrics can now be collected broker side.

\2

https://cwiki.apache.org/confluence/dis…

1 1

Kafka Streams @kafkastreams.bsky.social · Apr 5

Apache Kafka 4.0 was released recently. We got a couple of a cool KIPs shipped.

KIP-1065: cwiki.apache.org/confluence/p...

The ProductionExceptionHandler becomes more flexible. It’s now also called for retriable errors. This allows you to break (previously infinite) retry loops.

\1

https://cwiki.apache.org/confluence/pag…

1 1 1

Reposted by Kafka Streams

Sophie Blee-Goldman @ableegoldman.bsky.social · Mar 11

Next up in the Kafka Streams 101 series: performance optimization!

Admittedly this one goes way beyond just the "101" level, with general tips to incredibly specific optimization techniques.

Check it out to get a handle on your application's performance: bit.ly/43zXoQM

Kafka Streams 101: Optimizing your apps for maximum performance

Learn the concepts, configs, and application design strategies to get your Kafka Streams apps running as optimally as possible.

bit.ly

2 5

Reposted by Kafka Streams

Neil Buesing @nbuesing.bsky.social · Mar 5

@intellijidea.com's IDE has a great Apache Kafka plugin.

This is a @kafkastreams.bsky.social's session window changelog topic -- maybe I can figure out how to get support natively for Kafka Stream windowing keys.

1 3 8

Kafka Streams @kafkastreams.bsky.social · Feb 26

Writing and a running a Kafka Streams app can be trickier than you'd think! We have some basic examples in the repo but they don't cover everything. Glad to have more material focused on helping new people get into Kafka Streams!

Sophie Blee-Goldman @ableegoldman.bsky.social · Feb 26

Next entry in the Kafka Streams 101 series: application lifecycle.

Very beginner friendly, but even the pros might find a useful tip or two -- for example: have you heard of the new standby task listener?

Check it out: www.responsive.dev/blog/app-lif...

Kafka Streams 101: Application Lifecycle

Learn how to properly start, stop, and manage the lifecycle of Kafka Streams

www.responsive.dev

2

Reposted by Kafka Streams

Sophie Blee-Goldman @ableegoldman.bsky.social · Feb 18

We're keeping the ball rolling on the Kafka Streams 101 series with yet another blog post! This time the focus is on configuration, and breaking down the most important configs to focus on for various needs (such as correctness, resiliency, etc)

Check it out here: www.responsive.dev/blog/importa...

Kafka Streams 101: The Most Important Configs

Learn which configurations are most critical for a reliable and efficient deployment

www.responsive.dev

6 8

Reposted by Kafka Streams

Sophie Blee-Goldman @ableegoldman.bsky.social · Feb 13

The 2025 blog post series has begun and we're kicking things off with the "official" Kafka Streams upgrade-guide -- check it out for best practices when setting up a new app, rules for safe vs unsafe upgrades, and tips for making the process go smoothly: www.responsive.dev/blog/topolog...

Kafka Streams 101: Topology Upgrades

A Kafka Streams 101 lesson to learn how to identify unsafe changes to a topology and the techniques to mitigate them

www.responsive.dev

1 2 5

Reposted by Kafka Streams

Matthias J. Sax @mjsax.bsky.social · Feb 7

#StreamProcessing with @kafkastreams.bsky.social

3 15

Reposted by Kafka Streams

Matthias J. Sax @mjsax.bsky.social · Dec 20

Another holiday 🎁 delivered. We completed issues.apache.org/jira/browse/... to remove all deprecated #KafkaStreams APIs for the upcoming #ApacheKafka 4.0 release!

It was an outstanding community effort and huge win!

We merged 36 PRs from 14 different contributors, removing 13K LOC.

\1

[KAFKA-16332] Remove Deprecated builder methods for Time/Session/Join/SlidingWindows - ASF JIRA

issues.apache.org

1 4 15

Kafka Streams @kafkastreams.bsky.social · Dec 20

Note: this is the official Apache Kafka Streams account and does not endorse specific vendors, though we may share content from external sources that is relevant to open source Kafka Streams.

For hot takes and broader community updates, follow the unofficial account @thestreamingotter.bsky.social

5

Kafka Streams @kafkastreams.bsky.social · Dec 20

Kafka Streams has officially come to Bluesky! Follow this account for updates on everything Kafka Streams and keep up to date with new features, bug fixes, and upcoming KIPs.

Long live the otter!

1 7 16