Lightnews — Scholar-powered news

Adam Bellemare @abellemare.bsky.social · 12d

Also thank you, of course, to Confluent, for sponsoring me and supporting me with both time and technical expertise while I worked on this book (note: I work for Confluent now, but didn't when I wrote the first edition).

Adam Bellemare @abellemare.bsky.social · 12d

I'd like to thank everyone at O'Reilly for everything they've done to make this book a reality. They have some of the best editors, production managers, and content reviewers that I've ever worked with.

1

Adam Bellemare @abellemare.bsky.social · 12d

(con't) New content includes (but not limited to):
- A major revision to building, managing, and deploying services in the age of cloud computing (remember, I started the first book in 2017: 8 years ago).
- How to handle bad data in event streams.

1

Adam Bellemare @abellemare.bsky.social · 12d

New content includes (but not limited to):
- An extensive focus on event design, including types of events, schema usage, mapping to streams, and changes through time.
- A major revision of the types of frameworks you can use to build your event-driven services.

1

Adam Bellemare @abellemare.bsky.social · 12d

You can also find it as an ebook PDF from Confluent (www.confluent.io/resources/eb...) , or printed in paper on various online sellers starting in mid-to-late October.

Building Event-Driven Microservices, 2E

Kafka can autoscale guarantee resilience minimize operational overhead secure your data save you money.

www.confluent.io

1

Adam Bellemare @abellemare.bsky.social · 12d

It's DONE. SHIP IT.

Finished my 2nd edition of Building Event-Driven Microservices, published by @oreilly.bsky.social and sponsored by the good people at @confluent.io.

You can find this book on the O'Reilly learning platform (www.oreilly.com/library/view... - you get a free trial!),

Building Event-Driven Microservices, 2nd Edition

Event-driven microservices offer an optimal approach to harnessing event streams, reacting and responding to changes as they occur across your company. With this fully revised and... - Selection from ...

www.oreilly.com

1 2 10

Adam Bellemare @abellemare.bsky.social · Apr 7

Pretty slick blog from my (new!) colleague Gunnar Morling. Check out GraalVM for native binaries with Kafka

Gunnar Morling @gunnarmorling.dev · Apr 7

📝 Blogged: "Building a Native Binary for Apache Kafka on macOS"

Quick write-up on using the #GraalVM config from KIP-974 for building a self-contained, native Kafka executable.

👉 www.morling.dev/blog/buildin...

$native-image --no-fallback \ --enable-http \ --enable-https \ --allow-incomplete-classpath \ --report-unsupported-elements-at-runtime \ --install-exit-handlers \ --enable-monitoring=jmxserver,jmxclient,heapdump,jvmstat \ -H:+ReportExceptionStackTraces \ -H:+EnableAllSecurityServices \ -H:EnableURLProtocols=http,https \ -H:AdditionalSecurityProviders=sun.security.jgss.SunProvider \ -H:ReflectionConfigurationFiles=docker/native/native-image-configs/reflect-config.json \ -H:JNIConfigurationFiles=docker/native/native-image-configs/jni-config.json \ -H:ResourceConfigurationFiles=docker/native/native-image-configs/resource-config.json \ -H:SerializationConfigurationFiles=docker/native/native-image-configs/serialization-config.json \ -H:PredefinedClassesConfigurationFiles=docker/native/native-image-configs/predefined-classes-config.json \ -H:DynamicProxyConfigurationFiles=docker/native/native-image-configs/proxy-config.json \ --verbose \ -march=compatibility \ -cp "core/build/distributions/kafka_2.13-4.1.0-SNAPSHOT/libs/*" kafka.docker.KafkaDockerWrapper \ -o "native-kafka"; say "Enjoy native Kafka"$

2 10

Reposted by Adam Bellemare

UXDX @uxdx.com · Mar 21

How many times does your organization process the same data?

@abellemare.bsky.social introduces a shift left approach, minimizing duplication by processing data once and making it accessible across different use cases. Read here: https://www.infoq.com/articles/rethinking-medallion-architecture/

The End of the Bronze Age: Rethinking the Medallion Architecture

A shift left approach to data processing relies on data products that form the basis of data communication across the business. This addresses many flaws in traditional data processing and makes data more relevant, complete, and trustworthy.

www.infoq.com

1

Adam Bellemare @abellemare.bsky.social · Feb 10

$1.5B for less than $20M ARR? Yikes. Is this a repeat of Databricks buying Tabular?

Jack Vanlightly @vanlightly.bsky.social · Feb 3

Speculation is growing that Snowflake is planning to acquire Redpanda—but why? What justifies the rumored high price tag? When you consider market trends, the Snowflake vs. Databricks rivalry, and the AI shift, the rationale starts to become clear. Here’s my take. jack-vanlightly.com/blog/2025/2/...

Why Snowflake wants streaming — Jack Vanlightly

Rumors are swirling that Snowflake intends to acquire Redpanda and many are questioning why and what impact this might have on Confluent. First, let’s remember that these are just rumors and there’s...

jack-vanlightly.com

2

Adam Bellemare @abellemare.bsky.social · Feb 9

Apologies for the late reply - I was on vacation and unplugged!

Shift left is makes data readily available to whatever systems need it. Streams get it there in near-realtime. Iceberg Table into Silver layer is slower and typically part of a data lake. It may or may not be suitable for operations

1 1

Adam Bellemare @abellemare.bsky.social · Jan 30

My new post is available on InfoQ. The bronze age is over! Rethink the medallion architecture.

www.infoq.com/articles/ret...

The End of the Bronze Age: Rethinking the Medallion Architecture

A shift left approach to data processing relies on data products that form the basis of data communication across the business. This addresses many flaws in traditional data processing and makes data ...

www.infoq.com

1 3 8

Adam Bellemare @abellemare.bsky.social · Jan 23

Building Event-Driven Microservices 2nd Edition is a go!

It's an ambitious release date, targeting the end of this year. 😬

5

Adam Bellemare @abellemare.bsky.social · Jan 23

Round - the warmest of shapes!

Adam Bellemare @abellemare.bsky.social · Jan 23

Man, I sure do love the Gulf of Mexico. Check out that Mexico Basin!

Adam Bellemare @abellemare.bsky.social · Jan 3

Gotta keep those AI models warm with something...

1

Adam Bellemare @abellemare.bsky.social · Dec 9

I'm thinking of writing a second edition of Building Event-Driven Microservices. Any requests for specific subjects to tackle?

Amazon.ca

www.amazon.ca

2

Reposted by Adam Bellemare

Danica Fine @thedanicafine.bsky.social · Oct 31

Since we're kicking things off around here, again, I may as well find the rest of my fellow Kafka fans:

It's rough out there. Know the signs. Know what your loved ones are saying about #apacheKafka.

2 7 32

Adam Bellemare @abellemare.bsky.social · Dec 4

Hey look - AWS just released managed Apache Iceberg tables.
aws.amazon.com/about-aws/wh...

Announcing Amazon S3 Tables – Fully managed Apache Iceberg tables optimized for analytics workloads - AWS

Discover more about what's new at AWS with Announcing Amazon S3 Tables – Fully managed Apache Iceberg tables optimized for analytics workloads

aws.amazon.com

Adam Bellemare @abellemare.bsky.social · Dec 4

And the winner is: Apache Iceberg!

Please commence the flame wars in the comments below.

www.bigdatawire.com/2024/12/03/h...

How Apache Iceberg Won the Open Table Wars

Apache Iceberg has recently emerged as the de facto open-table standard for large-scale datasets, with a thriving community and support from many of the

www.bigdatawire.com

1 1 5

Reposted by Adam Bellemare

Nikhil Benesch @benesch.bsky.social · Dec 4

S3 (Iceberg) Tables is everything I dreamt of, and more. I blogged some long-form thoughts: meltware.com/2024/12/04/s...

I think we're about to see an explosion of data tools (@materialize.com, @clickhouse.com, @duckdb.org, et al.) learn to write Iceberg tables via S3 table buckets.

#databs

A First Look at S3 (Iceberg) Tables

AWS announced S3 Tables today, which brings native support for Apache Iceberg to S3. It’s hard to overstate how exciting this is for the data analytics ecosystem. This post is a quick rundown of my th...

meltware.com

15 38 110

Reposted by Adam Bellemare

Hank Green @hankgreen.bsky.social · Dec 3

The deep goal of bluesky is to decentralize the social internet so that every individual controls their experience of it rather than having it be controlled by 5 random billionaires. Everyone thinks they signed up for a demuskified twitter...we actually signed an exciting and bizarre experiment.

1.3K 6.4K 58K

Adam Bellemare @abellemare.bsky.social · Dec 4

My colleagues at Confluent just put out this video. I'm sharing because it's an homage to Wes Anderson, but also... really cool pastel colors, sets, vintage computers, and a mention to one of my favourite Canadian places, Victoria Island, BC!
www.youtube.com/watch?v=IQ3V...

Confluent Developer but Wes Anderson.

YouTube video by Confluent Developer

www.youtube.com

1

Adam Bellemare @abellemare.bsky.social · Dec 4

Thansk Andrew. I have a few more parts coming out yet (maybe 2, definitely 1), so stay tuned.

1

Adam Bellemare @abellemare.bsky.social · Dec 2

Just published part II of "How to Design Event Streams". Check it out here.

How to Design Event Streams, Part 2

This article covers the degree of normalization when using events created from a relational source, and how to go about denormalizing them.

dzone.com

1 1 4

Adam Bellemare @abellemare.bsky.social · Nov 30

They're popping up like mushrooms after a rain!
It's good to see the Kafka API is so widely adopted though, and the de-facto standard.

4