Apurva Mehta
@apurvamehta.com
Co-Founder and CEO of @responsive.dev. I write about stream processing and company building. Views are my own.
🌐 apurvamehta.com
🌐 apurvamehta.com
Reposted by Apurva Mehta
Today marks SlateDB’s one year anniversary! It’s been a lot of fun. Thanks to @rohanpd.bsky.social @flaneur2024.bsky.social @almog.ai @vigneshc.bsky.social @paulbutler.org Jason Gustafson, David Moravek, and many others for joining the project. 😀
SlateDB - An embedded storage engine built on object storage | SlateDB
Description will go into a meta tag in <head />
SlateDB.io
April 22, 2025 at 9:55 PM
Today marks SlateDB’s one year anniversary! It’s been a lot of fun. Thanks to @rohanpd.bsky.social @flaneur2024.bsky.social @almog.ai @vigneshc.bsky.social @paulbutler.org Jason Gustafson, David Moravek, and many others for joining the project. 😀
Reposted by Apurva Mehta
I’m a sucker for a good cost calculator. This one is pretty slick. Lots of components contribute to cost in Kafka Streams.
March 31, 2025 at 2:28 PM
I’m a sucker for a good cost calculator. This one is pretty slick. Lots of components contribute to cost in Kafka Streams.
Reposted by Apurva Mehta
SlateDB 0.5.0 is out!
Features:
- Checkpoints
- Clones
- Read only client
- Split/merge database foundation
- TTL filtering on reads
- Last version with breaking byte format changes
By the numbers:
- 62 commits
- 2 new contributors
- 10 total contributors
github.com/slatedb/slat...
Features:
- Checkpoints
- Clones
- Read only client
- Split/merge database foundation
- TTL filtering on reads
- Last version with breaking byte format changes
By the numbers:
- 62 commits
- 2 new contributors
- 10 total contributors
github.com/slatedb/slat...
Release v0.5.0 · slatedb/slatedb
What's Changed
Refactor Block Tests to Use Table-Driven Test Cases by @samsond in #410
Update await calls in README.md by @criccomini in #425
chore: Apply table driven test for sst.rs by @jeffreyl...
github.com
March 17, 2025 at 5:23 PM
SlateDB 0.5.0 is out!
Features:
- Checkpoints
- Clones
- Read only client
- Split/merge database foundation
- TTL filtering on reads
- Last version with breaking byte format changes
By the numbers:
- 62 commits
- 2 new contributors
- 10 total contributors
github.com/slatedb/slat...
Features:
- Checkpoints
- Clones
- Read only client
- Split/merge database foundation
- TTL filtering on reads
- Last version with breaking byte format changes
By the numbers:
- 62 commits
- 2 new contributors
- 10 total contributors
github.com/slatedb/slat...
Reposted by Apurva Mehta
Related: super interesting discussion on stateful stream processing vs OLTP with @apurvamehta.com from @responsive.dev open.spotify.com/episode/1hsH... (start at 18:46)
Reinventing Stream Processing: From LinkedIn to Responsive with Apurva Mehta
Tech on the Rocks · Episode
open.spotify.com
March 16, 2025 at 4:54 PM
Related: super interesting discussion on stateful stream processing vs OLTP with @apurvamehta.com from @responsive.dev open.spotify.com/episode/1hsH... (start at 18:46)
Reposted by Apurva Mehta
I'm always excited to chat with @apurvamehta.com about what @responsive.dev is building.
Streaming and real time as terms are being constantly reinvented as the market needs change rapidly, and Apurva is one of the best to talk about that.
Check the conversation here: techontherocks.show/15
Streaming and real time as terms are being constantly reinvented as the market needs change rapidly, and Apurva is one of the best to talk about that.
Check the conversation here: techontherocks.show/15
Tech on the Rocks | Reinventing Stream Processing: From LinkedIn to Responsive with Apurva Mehta
SummaryIn this episode, Apurva Mehta, co-founder and CEO of Responsive, recounts his extensive journey in stream processing—from his early work at LinkedIn and Confluent to his current venture at R...
techontherocks.show
March 14, 2025 at 4:51 PM
I'm always excited to chat with @apurvamehta.com about what @responsive.dev is building.
Streaming and real time as terms are being constantly reinvented as the market needs change rapidly, and Apurva is one of the best to talk about that.
Check the conversation here: techontherocks.show/15
Streaming and real time as terms are being constantly reinvented as the market needs change rapidly, and Apurva is one of the best to talk about that.
Check the conversation here: techontherocks.show/15
Reposted by Apurva Mehta
I’m excited to listen to this one. Some of my favorite folks all in one podcast 😀
New episode: Reinventing Stream Processing with @apurvamehta.com from @responsive.dev
We cover:
Real-time vs low latency in streaming
Why stateful streaming is hard at scale
RocksDB, Postgres limitations
SQL vs flexible APIs
Decoupling state & compute with SlateDB.
🎧 👉
We cover:
Real-time vs low latency in streaming
Why stateful streaming is hard at scale
RocksDB, Postgres limitations
SQL vs flexible APIs
Decoupling state & compute with SlateDB.
🎧 👉
Tech on the Rocks
Join Kostas and Nitay as they speak with amazingly smart people who are building the next generation of technology, from hardware to cloud compute. Tech on the Rocks is for people who are curious…
techontherocks.show
March 6, 2025 at 7:20 PM
I’m excited to listen to this one. Some of my favorite folks all in one podcast 😀
This week, our 101 series has @ableegoldman.bsky.social diving deep into the world of performance optimization for Kafka Streams.
This isn't just theory: she shows how we realized 10x throughput improvements by implementing these techniques in prod!
www.responsive.dev/blog/perform...
This isn't just theory: she shows how we realized 10x throughput improvements by implementing these techniques in prod!
www.responsive.dev/blog/perform...
Kafka Streams 101: Optimizing your apps for maximum performance
Learn the concepts, configs, and application design strategies to get your Kafka Streams apps running as optimally as possible.
www.responsive.dev
March 6, 2025 at 5:43 PM
This week, our 101 series has @ableegoldman.bsky.social diving deep into the world of performance optimization for Kafka Streams.
This isn't just theory: she shows how we realized 10x throughput improvements by implementing these techniques in prod!
www.responsive.dev/blog/perform...
This isn't just theory: she shows how we realized 10x throughput improvements by implementing these techniques in prod!
www.responsive.dev/blog/perform...
Reposted by Apurva Mehta
New episode: Reinventing Stream Processing with @apurvamehta.com from @responsive.dev
We cover:
Real-time vs low latency in streaming
Why stateful streaming is hard at scale
RocksDB, Postgres limitations
SQL vs flexible APIs
Decoupling state & compute with SlateDB.
🎧 👉
We cover:
Real-time vs low latency in streaming
Why stateful streaming is hard at scale
RocksDB, Postgres limitations
SQL vs flexible APIs
Decoupling state & compute with SlateDB.
🎧 👉
Tech on the Rocks
Join Kostas and Nitay as they speak with amazingly smart people who are building the next generation of technology, from hardware to cloud compute. Tech on the Rocks is for people who are curious…
techontherocks.show
March 6, 2025 at 5:25 PM
New episode: Reinventing Stream Processing with @apurvamehta.com from @responsive.dev
We cover:
Real-time vs low latency in streaming
Why stateful streaming is hard at scale
RocksDB, Postgres limitations
SQL vs flexible APIs
Decoupling state & compute with SlateDB.
🎧 👉
We cover:
Real-time vs low latency in streaming
Why stateful streaming is hard at scale
RocksDB, Postgres limitations
SQL vs flexible APIs
Decoupling state & compute with SlateDB.
🎧 👉
Reposted by Apurva Mehta
Next entry in the Kafka Streams 101 series: application lifecycle.
Very beginner friendly, but even the pros might find a useful tip or two -- for example: have you heard of the new standby task listener?
Check it out: www.responsive.dev/blog/app-lif...
Very beginner friendly, but even the pros might find a useful tip or two -- for example: have you heard of the new standby task listener?
Check it out: www.responsive.dev/blog/app-lif...
Kafka Streams 101: Application Lifecycle
Learn how to properly start, stop, and manage the lifecycle of Kafka Streams
www.responsive.dev
February 26, 2025 at 10:04 PM
Next entry in the Kafka Streams 101 series: application lifecycle.
Very beginner friendly, but even the pros might find a useful tip or two -- for example: have you heard of the new standby task listener?
Check it out: www.responsive.dev/blog/app-lif...
Very beginner friendly, but even the pros might find a useful tip or two -- for example: have you heard of the new standby task listener?
Check it out: www.responsive.dev/blog/app-lif...
Reposted by Apurva Mehta
We're keeping the ball rolling on the Kafka Streams 101 series with yet another blog post! This time the focus is on configuration, and breaking down the most important configs to focus on for various needs (such as correctness, resiliency, etc)
Check it out here: www.responsive.dev/blog/importa...
Check it out here: www.responsive.dev/blog/importa...
Kafka Streams 101: The Most Important Configs
Learn which configurations are most critical for a reliable and efficient deployment
www.responsive.dev
February 18, 2025 at 10:40 PM
We're keeping the ball rolling on the Kafka Streams 101 series with yet another blog post! This time the focus is on configuration, and breaking down the most important configs to focus on for various needs (such as correctness, resiliency, etc)
Check it out here: www.responsive.dev/blog/importa...
Check it out here: www.responsive.dev/blog/importa...
Reposted by Apurva Mehta
We are happy to announce that we have completed another SOC2 Type 2 audit along with completing another successful penetration test against our cloud services.
You can find the latest reports on our trust center: trust.responsive.dev
You can find the latest reports on our trust center: trust.responsive.dev
Responsive Trust Center
Responsive is a stream processing solution that brings disaggregated state, autoscaling, observability and enterprise-grade support to Kafka Streams. Eliminate unpredictable lag and rebalance instabil...
trust.responsive.dev
February 14, 2025 at 7:31 PM
We are happy to announce that we have completed another SOC2 Type 2 audit along with completing another successful penetration test against our cloud services.
You can find the latest reports on our trust center: trust.responsive.dev
You can find the latest reports on our trust center: trust.responsive.dev
(1/3) One of the hardest problems in the world of stream processing is upgrading stateful applications. Why? Because the events never stop, and your application has to handle the events correctly before and after a upgrade and if rewind your position in a topic.
February 13, 2025 at 5:46 PM
(1/3) One of the hardest problems in the world of stream processing is upgrading stateful applications. Why? Because the events never stop, and your application has to handle the events correctly before and after a upgrade and if rewind your position in a topic.
Reposted by Apurva Mehta
Had two people ask me for guidance about open source foundations this week. Lots of trepidation around Apache, not much familiarity with CNCF, and curiousity about why I chose Commonhaus for SlateDB.
Here are my thoughts:
Here are my thoughts:
Comparing Apache, CNCF, and Commonhaus | cnr.sh
I've used open source projects for over 30 years and contributed for about 20 of those. My first interaction with an open source foundation was with Apache when I began working with Apache Hadoop ...
cnr.sh
February 13, 2025 at 4:16 PM
Had two people ask me for guidance about open source foundations this week. Lots of trepidation around Apache, not much familiarity with CNCF, and curiousity about why I chose Commonhaus for SlateDB.
Here are my thoughts:
Here are my thoughts:
Reposted by Apurva Mehta
February 7, 2025 at 5:43 PM
Should you use Kafka? If so, when? And what are the tradeoffs presented by the dizzying variety of Kafka-adjacent technologies? I hope that my latest blog post provides unique and useful answers to these questions.
Let me know what you all think!
👉 www.responsive.dev/blog/why-whe...
Let me know what you all think!
👉 www.responsive.dev/blog/why-whe...
February 4, 2025 at 5:03 PM
Should you use Kafka? If so, when? And what are the tradeoffs presented by the dizzying variety of Kafka-adjacent technologies? I hope that my latest blog post provides unique and useful answers to these questions.
Let me know what you all think!
👉 www.responsive.dev/blog/why-whe...
Let me know what you all think!
👉 www.responsive.dev/blog/why-whe...
Reposted by Apurva Mehta
Thanks everyone for all the feedback on blog post ideas! Performance and upgrades were most popular so stay tuned for these deep dives - for beginners and advanced users alike
Check out our new Kafka Streams 101 site and subscribe to get notified for these and other upcoming lessons! bit.ly/40LWJZL
Check out our new Kafka Streams 101 site and subscribe to get notified for these and other upcoming lessons! bit.ly/40LWJZL
Kafka Streams 101 | Responsive
Learn to build bulletproof Kafka Streams applications
bit.ly
February 4, 2025 at 2:42 AM
Thanks everyone for all the feedback on blog post ideas! Performance and upgrades were most popular so stay tuned for these deep dives - for beginners and advanced users alike
Check out our new Kafka Streams 101 site and subscribe to get notified for these and other upcoming lessons! bit.ly/40LWJZL
Check out our new Kafka Streams 101 site and subscribe to get notified for these and other upcoming lessons! bit.ly/40LWJZL
This will be the foundation for being able to branch @kafkastreams.bsky.social apps to support seamless blue/green deploys. It also allows you to branch a previous version of the state to debug an issue from the past.
Powerful stuff coming to the world of stream processing!
Powerful stuff coming to the world of stream processing!
SlateDB now has clones 🤯
Users can clone an existing DB's data to a new location. It's nearly instantaneous since it references the data from the old bucket rather than copying. Writes to the clone update the new location. Compaction lazily merges old data into the new directory./ht @responsive.dev
Users can clone an existing DB's data to a new location. It's nearly instantaneous since it references the data from the old bucket rather than copying. Writes to the clone update the new location. Compaction lazily merges old data into the new directory./ht @responsive.dev
Initial clone implementation by hachikuji · Pull Request #430 · slatedb/slatedb
Fixes #315. This patch contains the logic to create and initialize clones as outlined in RFC-0004.
github.com
February 3, 2025 at 7:06 PM
This will be the foundation for being able to branch @kafkastreams.bsky.social apps to support seamless blue/green deploys. It also allows you to branch a previous version of the state to debug an issue from the past.
Powerful stuff coming to the world of stream processing!
Powerful stuff coming to the world of stream processing!
I'm enjoying putting the finishing touches on my next blog post on the Why, When, and How of Kafka applications.
It's a distillation of my point of view from a decade in the space and I hope it's as useful to read as it was fun to write.
Coming Tuesday!
It's a distillation of my point of view from a decade in the space and I hope it's as useful to read as it was fun to write.
Coming Tuesday!
February 2, 2025 at 7:40 PM
I'm enjoying putting the finishing touches on my next blog post on the Why, When, and How of Kafka applications.
It's a distillation of my point of view from a decade in the space and I hope it's as useful to read as it was fun to write.
Coming Tuesday!
It's a distillation of my point of view from a decade in the space and I hope it's as useful to read as it was fun to write.
Coming Tuesday!
I've used ChatGPT and/or Gemini to brainstorm ideas for presenting concepts visually multiple times recently. They have unlocked ideas I wouldn't have thought of otherwise.
And sometimes, they generate the graphics. For the rest, Figma is perfect.
It's such a major boost either way!
And sometimes, they generate the graphics. For the rest, Figma is perfect.
It's such a major boost either way!
January 30, 2025 at 8:25 PM
I've used ChatGPT and/or Gemini to brainstorm ideas for presenting concepts visually multiple times recently. They have unlocked ideas I wouldn't have thought of otherwise.
And sometimes, they generate the graphics. For the rest, Figma is perfect.
It's such a major boost either way!
And sometimes, they generate the graphics. For the rest, Figma is perfect.
It's such a major boost either way!
Reposted by Apurva Mehta
How did Responsive simplify its architecture and achieve monstrously high availability with unlimited scale potential? Co-founder @almog.ai will share how replacing RocksDB with #ScyllaDB in #Kafka Streams led to big wins for their team at Monster Scale Summit. www.scylladb.com/monster-scal...
January 29, 2025 at 3:18 PM
How did Responsive simplify its architecture and achieve monstrously high availability with unlimited scale potential? Co-founder @almog.ai will share how replacing RocksDB with #ScyllaDB in #Kafka Streams led to big wins for their team at Monster Scale Summit. www.scylladb.com/monster-scal...
The first of our Kafka Streams 101 Series. Practical knowledge on thinking about windowing and time in @kafkastreams.bsky.social
We are going to ship new tutorials regularly over the next few months, and you can find them all here: www.responsive.dev/resources/ka...
We are going to ship new tutorials regularly over the next few months, and you can find them all here: www.responsive.dev/resources/ka...
Kafka Streams 101: Windows & Time!
🕰️ What's the difference between event, stream and wall clock time?
🪟 What are the four different types of windows?
⁉️ What are the important error messages and metrics, and what do they mean?
👉 Read the full lesson here: www.responsive.dev/blog/windows...
🕰️ What's the difference between event, stream and wall clock time?
🪟 What are the four different types of windows?
⁉️ What are the important error messages and metrics, and what do they mean?
👉 Read the full lesson here: www.responsive.dev/blog/windows...
January 28, 2025 at 5:14 PM
The first of our Kafka Streams 101 Series. Practical knowledge on thinking about windowing and time in @kafkastreams.bsky.social
We are going to ship new tutorials regularly over the next few months, and you can find them all here: www.responsive.dev/resources/ka...
We are going to ship new tutorials regularly over the next few months, and you can find them all here: www.responsive.dev/resources/ka...
Reposted by Apurva Mehta
There are some learnings that only come from having seen a wildly successful technology go from a nascent project to ubiquitous. These insights can change the trajectory for new tech.
Jason's summary about error handling is a great read for practical engineers: github.com/slatedb/slat...
Jason's summary about error handling is a great read for practical engineers: github.com/slatedb/slat...
API Error Guidance · Issue #454 · slatedb/slatedb
Dumping a few thoughts on API errors. At the moment, we have a single flat error SlateDBError which is exposed through the public API. This is the same pattern used in Kafka and there are some less...
github.com
January 23, 2025 at 4:53 AM
There are some learnings that only come from having seen a wildly successful technology go from a nascent project to ubiquitous. These insights can change the trajectory for new tech.
Jason's summary about error handling is a great read for practical engineers: github.com/slatedb/slat...
Jason's summary about error handling is a great read for practical engineers: github.com/slatedb/slat...
Sophie arguably has the best @kafkastreams.bsky.social blog posts on the internet. Now you get a say on what she should write about next!
[1/5] Hey fellow Kafka Streams otters! You may have already seen my previous blog posts such as the "Debugging Rebalances" and "EOS guide" from last year (and if you haven't, go check them out! Links in thread)
But now it's 2025, and time for me to think about what to write next...
But now it's 2025, and time for me to think about what to write next...
January 15, 2025 at 4:13 AM
Sophie arguably has the best @kafkastreams.bsky.social blog posts on the internet. Now you get a say on what she should write about next!
👋
Kafka Streams has officially come to Bluesky! Follow this account for updates on everything Kafka Streams and keep up to date with new features, bug fixes, and upcoming KIPs.
Long live the otter!
Long live the otter!
December 20, 2024 at 6:31 AM
👋
Kafka Streams had an amazing 2024! Check out @ableegoldman.bsky.social's year in review, where she recaps the 25 major improvements the community made to Kafka Streams!
www.responsive.dev/blog/kafka-s...
www.responsive.dev/blog/kafka-s...
Kafka Streams Wrapped: 2024 in review
Kafka Streams had some tremendous additions and improvements in 2024. Here are the highlights.
www.responsive.dev
December 19, 2024 at 8:00 PM
Kafka Streams had an amazing 2024! Check out @ableegoldman.bsky.social's year in review, where she recaps the 25 major improvements the community made to Kafka Streams!
www.responsive.dev/blog/kafka-s...
www.responsive.dev/blog/kafka-s...