Arindam Das
@arindas.bsky.social
Specializes in distributed systems, deep learning inference and AI SaaS at scale. MLOps Engineer at Claritas Healthtech (http://claritashealthtech.com)
Reposted by Arindam Das
Amazon S3 just grew "append"! It's only available for the more expensive, lower latency S3 Express One Zone bucket class but you can now append data to an object up to 10,000 times - previously you could only atomically replace a whole object with an updated version simonwillison.net/2024/Nov/22/...
Amazon S3 Express One Zone now supports the ability to append data to an object
This is a first for Amazon S3: it is now possible to append data to an existing object in a bucket, where previously the only supported operation was to atomically …
simonwillison.net
November 22, 2024 at 4:47 AM
Amazon S3 just grew "append"! It's only available for the more expensive, lower latency S3 Express One Zone bucket class but you can now append data to an object up to 10,000 times - previously you could only atomically replace a whole object with an updated version simonwillison.net/2024/Nov/22/...
Reposted by Arindam Das
Honored to see our paper on #DuckPGQ mentioned by @andypavlo.bsky.social during the CWI lectures! With the introduction of SQL/PGQ, we argue that relational systems (like #DuckDB) can seamlessly handle graph data. Check out the paper here: www.cidrdb.org/cidr2023/pap...
November 22, 2024 at 7:45 AM
Honored to see our paper on #DuckPGQ mentioned by @andypavlo.bsky.social during the CWI lectures! With the introduction of SQL/PGQ, we argue that relational systems (like #DuckDB) can seamlessly handle graph data. Check out the paper here: www.cidrdb.org/cidr2023/pap...
Reposted by Arindam Das
The most impressive technical feat I’ve seen at #KubeCon this year by far was the Gödel scheduler by ByteDance.
A completely different scheduler design with sharding and optimistic concurrency achieving 2,000 pods/sec.
Blog: www.cncf.io/blog/2024/04...
Talk: youtu.be/PiUAdclow_4?...
A completely different scheduler design with sharding and optimistic concurrency achieving 2,000 pods/sec.
Blog: www.cncf.io/blog/2024/04...
Talk: youtu.be/PiUAdclow_4?...
Gödel Scheduler open-sourced: a unified scheduler for online and offline workloads
Member post by ByteDance Since its open-source release in 2014, Kubernetes has rapidly become the de facto standard for container orchestration. The infrastructure team at ByteDance adopted Kubernetes...
www.cncf.io
November 22, 2024 at 6:22 AM
The most impressive technical feat I’ve seen at #KubeCon this year by far was the Gödel scheduler by ByteDance.
A completely different scheduler design with sharding and optimistic concurrency achieving 2,000 pods/sec.
Blog: www.cncf.io/blog/2024/04...
Talk: youtu.be/PiUAdclow_4?...
A completely different scheduler design with sharding and optimistic concurrency achieving 2,000 pods/sec.
Blog: www.cncf.io/blog/2024/04...
Talk: youtu.be/PiUAdclow_4?...
Reposted by Arindam Das
This might be useful for some use cases: S3 Express One Zone now allows appending existing objects
docs.aws.amazon.com/AmazonS3/lat...
docs.aws.amazon.com/AmazonS3/lat...
Appending data to objects in directory buckets - Amazon Simple Storage ServiceAppending data to objects in directory buckets - Amazon Simple Storage Service
Learn how to append data to existing objects in directory buckets.
docs.aws.amazon.com
November 22, 2024 at 7:16 AM
This might be useful for some use cases: S3 Express One Zone now allows appending existing objects
docs.aws.amazon.com/AmazonS3/lat...
docs.aws.amazon.com/AmazonS3/lat...