Abhay Bothra
@swe.dev
Co-founder/CTO @fennel.ai / Databases #DataBS / Distributed Systems / Infrastructure. @bothra90 on Twitter.
Great thread from @micahw.com. Adding some of our own learnings from building this in Fennel.
An additional advantage for us was that it allowed us to keep data in columnar format for longer instead of converting back-and-forth between operators for serialization.
An additional advantage for us was that it allowed us to keep data in columnar format for longer instead of converting back-and-forth between operators for serialization.
Is #DataBS interested in the internals of streaming engines? The next release of arroyo.dev (0.13) has a new feature in the core dataflow called operator chaining which gets at some of the interesting details of how these systems work. So let’s dive in to streaming dataflow 🧵
Arroyo — Cloud-native stream processing
Arroyo is the easiest way to run SQL queries against your streaming data
arroyo.dev
December 6, 2024 at 5:43 AM
Great thread from @micahw.com. Adding some of our own learnings from building this in Fennel.
An additional advantage for us was that it allowed us to keep data in columnar format for longer instead of converting back-and-forth between operators for serialization.
An additional advantage for us was that it allowed us to keep data in columnar format for longer instead of converting back-and-forth between operators for serialization.
Reposted by Abhay Bothra
Clusters are getting squeezed from above by smarter control planes, and from below by cheap and consistent object storage.
www.linkedin.com/pulse/contro...
www.linkedin.com/pulse/contro...
Control Planes and the Death of the Cluster
The recent (few years) rediscovery of control plane architecture, largely due to the success of Kubernetes, is changing the way people think about distributed systems. Not many years ago, everything "...
www.linkedin.com
November 24, 2024 at 8:04 PM
Clusters are getting squeezed from above by smarter control planes, and from below by cheap and consistent object storage.
www.linkedin.com/pulse/contro...
www.linkedin.com/pulse/contro...
Reposted by Abhay Bothra
TIL AWS un-launched S3 Select[1] as of July 25, 2024, presumably in favor of S3 Object Lambda[2]. RIP PushdownDB (arxiv.org/abs/2002.0...).
[1]: aws.amazon.com/blogs...
[2]: aws.amazon.com/s3/fe...
[1]: aws.amazon.com/blogs...
[2]: aws.amazon.com/s3/fe...
November 18, 2024 at 4:15 AM
TIL AWS un-launched S3 Select[1] as of July 25, 2024, presumably in favor of S3 Object Lambda[2]. RIP PushdownDB (arxiv.org/abs/2002.0...).
[1]: aws.amazon.com/blogs...
[2]: aws.amazon.com/s3/fe...
[1]: aws.amazon.com/blogs...
[2]: aws.amazon.com/s3/fe...