WarpStream
@warpstream.com
WarpStream is a diskless, Apache Kafka®-compatible data streaming platform built directly on top of object storage: zero disks, zero inter-AZ fees, zero access.
WarpStream Tableflow support keeps expanding. Check out our latest updates.
✅ Get early access: buff.ly/EdGXb1Q
📕 Tableflow docs: buff.ly/cGDz7xY
✅ Get early access: buff.ly/EdGXb1Q
📕 Tableflow docs: buff.ly/cGDz7xY
December 23, 2025 at 2:01 PM
WarpStream Tableflow support keeps expanding. Check out our latest updates.
✅ Get early access: buff.ly/EdGXb1Q
📕 Tableflow docs: buff.ly/cGDz7xY
✅ Get early access: buff.ly/EdGXb1Q
📕 Tableflow docs: buff.ly/cGDz7xY
Dealing with rejection (in distributed systems):
🤔 Theory vs. practice.
📈 What is backpressure?
✨ The backpressuring Goldilocks zone.
📉 How we manage backpressure for our Produce and Fetch requests in our Agents (with before-and-after results).
🤔 Theory vs. practice.
📈 What is backpressure?
✨ The backpressuring Goldilocks zone.
📉 How we manage backpressure for our Produce and Fetch requests in our Agents (with before-and-after results).
Dealing with rejection (in distributed systems)
Backpressure is a really simple concept. When the system is nearing overload, it should start “saying no” by slowing down or rejecting requests. Of course, the big question is: How do we know when we…
buff.ly
December 22, 2025 at 2:30 PM
Dealing with rejection (in distributed systems):
🤔 Theory vs. practice.
📈 What is backpressure?
✨ The backpressuring Goldilocks zone.
📉 How we manage backpressure for our Produce and Fetch requests in our Agents (with before-and-after results).
🤔 Theory vs. practice.
📈 What is backpressure?
✨ The backpressuring Goldilocks zone.
📉 How we manage backpressure for our Produce and Fetch requests in our Agents (with before-and-after results).
Measuring consumer group lag in Kafka using offsets isn't always the best approach. Time lag makes it much easier to monitor and troubleshoot consumer groups. Time lag measurement is built directly into WarpStream – no third-party tooling is needed 👉 buff.ly/gDGiEpZ
December 19, 2025 at 3:03 PM
Measuring consumer group lag in Kafka using offsets isn't always the best approach. Time lag makes it much easier to monitor and troubleshoot consumer groups. Time lag measurement is built directly into WarpStream – no third-party tooling is needed 👉 buff.ly/gDGiEpZ
Thanks to Snowcat Cloud for making this video about Bento, the free, open-source stream processing framework maintained by WarpStream. Learn more 👇
Blog about how it came to be 👉 buff.ly/9MX2bXS
Bento website 👉 buff.ly/WxPmqcX
Blog about how it came to be 👉 buff.ly/9MX2bXS
Bento website 👉 buff.ly/WxPmqcX
December 18, 2025 at 3:06 PM
Thanks to Snowcat Cloud for making this video about Bento, the free, open-source stream processing framework maintained by WarpStream. Learn more 👇
Blog about how it came to be 👉 buff.ly/9MX2bXS
Bento website 👉 buff.ly/WxPmqcX
Blog about how it came to be 👉 buff.ly/9MX2bXS
Bento website 👉 buff.ly/WxPmqcX
ACLs are needed for security, but enabling them in production carries risks. @warpstream.com ACL Shadowing evaluates ACLs before enforcing them, so engineers can identify and fix issues safely 👉 www.warpstream.com/blog/shadowi...
December 17, 2025 at 3:10 PM
ACLs are needed for security, but enabling them in production carries risks. @warpstream.com ACL Shadowing evaluates ACLs before enforcing them, so engineers can identify and fix issues safely 👉 www.warpstream.com/blog/shadowi...
⚫ Dim the lights. WarpStream's Console now has a dark mode. Access it in Account > Appearance. 🔅
December 16, 2025 at 2:02 PM
⚫ Dim the lights. WarpStream's Console now has a dark mode. Access it in Account > Appearance. 🔅
WarpStream supports SPIFFE (Secure Production Identity Framework For Everyone) for mTLS and ACLs, enabling automated, cryptographically-verified service identities for strong mutual authentication and granular access control.
Mutual TLS (mTLS) | WarpStream
This page describes how to configure the Agents to enforce mTLS.
buff.ly
December 15, 2025 at 2:31 PM
WarpStream supports SPIFFE (Secure Production Identity Framework For Everyone) for mTLS and ACLs, enabling automated, cryptographically-verified service identities for strong mutual authentication and granular access control.
WarpStream Tableflow's architecture takes inspiration from React's virtual DOM, enabling exactly-once ingestion and millions of Iceberg updates per second while ensuring data lake correctness.
What React and Apache Iceberg Have in Common: Scaling Iceberg with Virtual Metadata
WarpStream Tableflow's architecture takes inspiration from React's virtual DOM, enabling exactly-once ingestion and millions of Iceberg updates per second while ensuring data lake correctness.
buff.ly
December 12, 2025 at 7:01 PM
WarpStream Tableflow's architecture takes inspiration from React's virtual DOM, enabling exactly-once ingestion and millions of Iceberg updates per second while ensuring data lake correctness.
🗑️ Distributed systems built on object storage share a common problem: removing files that have been logically deleted, either due to data expiry or compaction. What's the solution? We'll give a hint: it's not bucket policies or synchronous deletion. 🪣
Taking out the Trash: Garbage Collection of Object Storage at Massive Scale
Distributed systems built on object storage all have one common problem: removing files that have been logically deleted either due to data expiry or compaction. We review the pros and cons of five…
buff.ly
December 12, 2025 at 2:02 PM
🗑️ Distributed systems built on object storage share a common problem: removing files that have been logically deleted, either due to data expiry or compaction. What's the solution? We'll give a hint: it's not bucket policies or synchronous deletion. 🪣
Need to get Kafka topics into Iceberg tables? Don't use Spark or rely on tiered storage. Use WarpStream Tableflow. It's so simple that it almost feels like magic and does it with low latency while taking care of compaction.
The Case for an Iceberg-Native Database: Why Spark Jobs and Zero-Copy Kafka Won’t Cut It
We launched a new product called WarpStream Tableflow that is the easiest, cheapest, and most flexible way to convert Kafka topic data into Iceberg tables with low latency, and keep them compacted.
buff.ly
December 10, 2025 at 2:30 PM
Need to get Kafka topics into Iceberg tables? Don't use Spark or rely on tiered storage. Use WarpStream Tableflow. It's so simple that it almost feels like magic and does it with low latency while taking care of compaction.
What did Robinhood gain by switching from Kafka to WarpStream for its logging workloads?
💸 A 45% cost savings.
📊 Auto-scaling that keeps clusters right-sized.
👍 Simpler ops (no more noisy neighbors or complex networking).
💸 A 45% cost savings.
📊 Auto-scaling that keeps clusters right-sized.
👍 Simpler ops (no more noisy neighbors or complex networking).
Robinhood Swaps Kafka for WarpStream to Tame Logging Workloads and Costs
By switching from Kafka to WarpStream for their logging workloads, Robinhood saved 45%. WarpStream auto-scaling always keep clusters right-sized, and features like Agent Groups eliminate issues like n...
www.warpstream.com
December 9, 2025 at 4:07 PM
What did Robinhood gain by switching from Kafka to WarpStream for its logging workloads?
💸 A 45% cost savings.
📊 Auto-scaling that keeps clusters right-sized.
👍 Simpler ops (no more noisy neighbors or complex networking).
💸 A 45% cost savings.
📊 Auto-scaling that keeps clusters right-sized.
👍 Simpler ops (no more noisy neighbors or complex networking).
WarpStream's Multi‑Region Clusters replicate every write across 3 regions, delivering true RPO=0 and a 99.999% uptime SLA. Never lose a record, even during region‑wide outages.
Blog: buff.ly/LpAieyW
Product page: buff.ly/QYBjD0g
Docs: buff.ly/KetVazo
Blog: buff.ly/LpAieyW
Product page: buff.ly/QYBjD0g
Docs: buff.ly/KetVazo
WarpStream Multi-Region Clusters Overview
WarpStream Multi-Region Clusters guarantee zero data loss (RPO=0) out of the box with zero additional operational overhead. They offer multi-region consensus and automatic failover handling. Learn…
youtu.be
December 8, 2025 at 3:03 PM
WarpStream's Multi‑Region Clusters replicate every write across 3 regions, delivering true RPO=0 and a 99.999% uptime SLA. Never lose a record, even during region‑wide outages.
Blog: buff.ly/LpAieyW
Product page: buff.ly/QYBjD0g
Docs: buff.ly/KetVazo
Blog: buff.ly/LpAieyW
Product page: buff.ly/QYBjD0g
Docs: buff.ly/KetVazo
Did you know Cursor's Kafka-compatible data streaming infrastructure is powered by WarpStream? Learn about:
🙌 Why they picked Warpstream over OSK
⏲️ Latency
🔒 Data privacy
📊 Scaling and zero ops
🚀 And more
buff.ly/I1VJbZa
🙌 Why they picked Warpstream over OSK
⏲️ Latency
🔒 Data privacy
📊 Scaling and zero ops
🚀 And more
buff.ly/I1VJbZa
December 5, 2025 at 2:30 PM
Did you know Cursor's Kafka-compatible data streaming infrastructure is powered by WarpStream? Learn about:
🙌 Why they picked Warpstream over OSK
⏲️ Latency
🔒 Data privacy
📊 Scaling and zero ops
🚀 And more
buff.ly/I1VJbZa
🙌 Why they picked Warpstream over OSK
⏲️ Latency
🔒 Data privacy
📊 Scaling and zero ops
🚀 And more
buff.ly/I1VJbZa
Join @warpstream.com and @grafana.bsky.social for a Meetup on December 9 in Austin, TX.
🔐 Learn how WarpStream's zero-access BYOC model guarantees it is secure by default.
🤖 Learn about Grafana Labs AI assistant.
Register 👉 buff.ly/tu9MEO1
🔐 Learn how WarpStream's zero-access BYOC model guarantees it is secure by default.
🤖 Learn about Grafana Labs AI assistant.
Register 👉 buff.ly/tu9MEO1
December 4, 2025 at 2:04 PM
Join @warpstream.com and @grafana.bsky.social for a Meetup on December 9 in Austin, TX.
🔐 Learn how WarpStream's zero-access BYOC model guarantees it is secure by default.
🤖 Learn about Grafana Labs AI assistant.
Register 👉 buff.ly/tu9MEO1
🔐 Learn how WarpStream's zero-access BYOC model guarantees it is secure by default.
🤖 Learn about Grafana Labs AI assistant.
Register 👉 buff.ly/tu9MEO1
WarpStream BYOC Schema Registry is expanding: In addition to the existing support for Avro, it now includes support for Protobuf schemas. This functionality maintains complete compatibility with @confluent.io's Schema Registry.
Going All in on Protobuf With Schema Registry and Tableflow
We originally launched our BYOC Schema Registry product with full support for Avro schemas. We’re excited to share that our Schema Registry now supports Protobuf schemas, with complete compatibility w...
www.warpstream.com
December 3, 2025 at 5:43 PM
WarpStream BYOC Schema Registry is expanding: In addition to the existing support for Avro, it now includes support for Protobuf schemas. This functionality maintains complete compatibility with @confluent.io's Schema Registry.
Goldsky was hitting the limits of Kafka at scale with tens of thousands of partitions and petabytes of blockchain data. By moving to WarpStream, they cut costs by 90%, removed bottlenecks, and now scale seamlessly toward 100 PiBs and beyond 👉 buff.ly/psYF3fN
December 2, 2025 at 3:03 PM
Goldsky was hitting the limits of Kafka at scale with tens of thousands of partitions and petabytes of blockchain data. By moving to WarpStream, they cut costs by 90%, removed bottlenecks, and now scale seamlessly toward 100 PiBs and beyond 👉 buff.ly/psYF3fN
What are the benefits of WarpStream's zero disk or diskless architecture?
💸 Reduced costs.
📈 Auto-scaling.
🎯 Workload isolation.
📊 Easy integration with Managed Data Pipelines.
🔒 Zero access and BYOC native.
💸 Reduced costs.
📈 Auto-scaling.
🎯 Workload isolation.
📊 Easy integration with Managed Data Pipelines.
🔒 Zero access and BYOC native.
Zero Disks is Better (for Kafka) - Diskless Kafka
Follow up to "Tiered Storage Won't Fix Kafka", this post covers all the different advantages that WarpStream's Zero Disk / Diskless Architecture provides over Apache Kafka.
buff.ly
December 1, 2025 at 2:31 PM
What are the benefits of WarpStream's zero disk or diskless architecture?
💸 Reduced costs.
📈 Auto-scaling.
🎯 Workload isolation.
📊 Easy integration with Managed Data Pipelines.
🔒 Zero access and BYOC native.
💸 Reduced costs.
📈 Auto-scaling.
🎯 Workload isolation.
📊 Easy integration with Managed Data Pipelines.
🔒 Zero access and BYOC native.
Cloud disks are expensive. Really expensive. Most engineers intuitively understand this, but the magnitudes are worth considering 👉 buff.ly/48VFcVV
November 25, 2025 at 3:02 PM
Cloud disks are expensive. Really expensive. Most engineers intuitively understand this, but the magnitudes are worth considering 👉 buff.ly/48VFcVV
The phases of cloud infrastructure:
1️⃣ Software is given away. Add-ons sold.
2️⃣ Cloud migration. Costs went up instead of down.
3️⃣ Lift and shift BYOC with lots of fees.
Learn how WarpStream was developed as cloud-first to solve these issues.
1️⃣ Software is given away. Add-ons sold.
2️⃣ Cloud migration. Costs went up instead of down.
3️⃣ Lift and shift BYOC with lots of fees.
Learn how WarpStream was developed as cloud-first to solve these issues.
The Original Sin of Cloud Infrastructure
Many of today's most highly adopted open source “big data” infrastructure projects – like Cassandra, Kafka, Hadoop, etc. – follow a common story. A large company, startup or otherwise, faces a…
buff.ly
November 24, 2025 at 2:30 PM
The phases of cloud infrastructure:
1️⃣ Software is given away. Add-ons sold.
2️⃣ Cloud migration. Costs went up instead of down.
3️⃣ Lift and shift BYOC with lots of fees.
Learn how WarpStream was developed as cloud-first to solve these issues.
1️⃣ Software is given away. Add-ons sold.
2️⃣ Cloud migration. Costs went up instead of down.
3️⃣ Lift and shift BYOC with lots of fees.
Learn how WarpStream was developed as cloud-first to solve these issues.
WarpStream Agent Groups isolate workloads within the same Kafka environment, enabling consistent performance, simplified operations, and seamless scalability, without sacrificing flexibility or blowing your budget. Learn more 👉 buff.ly/VgrsF0r
How WarpStream Agent Groups help with Kafka demand spikes
https://www.warpstream.com/agent-groups | Viktor Gamov is at the lightboard to illustrate how WarpStream Agent Groups help Apache Kafka during unpredictable demand spikes. While traditional Kafka…
buff.ly
November 21, 2025 at 3:02 PM
WarpStream Agent Groups isolate workloads within the same Kafka environment, enabling consistent performance, simplified operations, and seamless scalability, without sacrificing flexibility or blowing your budget. Learn more 👉 buff.ly/VgrsF0r
Learn how WarpStream leverages Antithesis to do deterministic simulation testing for our entire SaaS — from sign up to creating a virtual cluster to producing and consuming data, and why we chose it over Jepsen.
Deterministic Simulation Testing for Our Entire SaaS
How we leverage Antithesis to deterministically simulate our entire SaaS platform and verify its correctness, all the way from signup to running entire Kafka workloads.
buff.ly
November 20, 2025 at 2:30 PM
Learn how WarpStream leverages Antithesis to do deterministic simulation testing for our entire SaaS — from sign up to creating a virtual cluster to producing and consuming data, and why we chose it over Jepsen.
WarpStream Tableflow is the easiest, cheapest, and most flexible way to convert Kafka topic data into Iceberg tables with low latency, and keep them compacted. Learn more 👉 buff.ly/2FbyQWe
November 19, 2025 at 2:03 PM
WarpStream Tableflow is the easiest, cheapest, and most flexible way to convert Kafka topic data into Iceberg tables with low latency, and keep them compacted. Learn more 👉 buff.ly/2FbyQWe
@superwall.bsky.social moves 100 MiB/s of events from @warpstream.com int @clickhouse.com Cloud, feeding a dataset of over 300 TB of total data that’s growing by 40 TB each month. WarpStream reduced Superwall's Kafka bill by 57%. Read the case study 👉 buff.ly/BzICDMu
November 18, 2025 at 3:03 PM
@superwall.bsky.social moves 100 MiB/s of events from @warpstream.com int @clickhouse.com Cloud, feeding a dataset of over 300 TB of total data that’s growing by 40 TB each month. WarpStream reduced Superwall's Kafka bill by 57%. Read the case study 👉 buff.ly/BzICDMu
WarpStream maintains the same ordering and idempotency guarantees as Kafka. Learn how we do this and how it enables our Agents to massively parallelize writes.
Unlocking Idempotency with Retroactive Tombstones
How we separated data from metadata to build support for idempotent producers in our Apache Kafka protocol layer.
buff.ly
November 17, 2025 at 2:03 PM
WarpStream maintains the same ordering and idempotency guarantees as Kafka. Learn how we do this and how it enables our Agents to massively parallelize writes.
What are the benefits of WarpStream Bring Your Own Cloud (BYOC), and why is zero better?
💾 Zero disks.
💸 Zero interzone networking fees.
📊 Zero ops auto-scaling.
🔒 Zero access.
buff.ly/rDmo83L
💾 Zero disks.
💸 Zero interzone networking fees.
📊 Zero ops auto-scaling.
🔒 Zero access.
buff.ly/rDmo83L
WarpStream Current 2024 Keynote: Bring Your Own Cloud (BYOC)
Check out our keynote from Confluent's Current 2024. Richard Artoul talked about the benefits of WarpStream BYOC and why zero is better:
✅ Zero disks
✅ Zero interzone networking fees
✅ Zero ops…
buff.ly
November 14, 2025 at 2:30 PM
What are the benefits of WarpStream Bring Your Own Cloud (BYOC), and why is zero better?
💾 Zero disks.
💸 Zero interzone networking fees.
📊 Zero ops auto-scaling.
🔒 Zero access.
buff.ly/rDmo83L
💾 Zero disks.
💸 Zero interzone networking fees.
📊 Zero ops auto-scaling.
🔒 Zero access.
buff.ly/rDmo83L