flaneur2024.bsky.social
@flaneur2024.bsky.social
maintainer of SlateDB
loves Rust, Datasys, Cloud Infra, AI
https://flaneur2020.github.io
since ChatGPT's 2022 release, almost all online content likely carries a 'background radiation' from AIGC. to seek purely human-written content, salvaging the pre-2022 internet content is your only choice. 🤔
November 20, 2025 at 11:30 AM
once a server pool is initialized, its storage layout, based on consistent hashing, becomes immutable. this design eliminates the need to consider dynamic node additions or removals within a cluster, thereby completely avoiding the complexities of rebalancing, allowing a no-metadata design. 🤔
November 9, 2025 at 1:32 PM
we can see a similar philosophy at play with MinIO's server pools. it's somewhat counter-intuitive that you can't simply expand the capacity of an existing MinIO cluster (server pool). instead, to scale, you must add an entirely new, fixed-size cluster (server pool) to the system.
November 9, 2025 at 1:30 PM
in an LWS cluster, the leader node first start up to awaiting the joins of the worker nodes. if even a single node fails, the entire cluster is rebuilt. my understanding is that this design simplifies dynamic, continuous membership management into a one-time operation at the initliazation phase. 🤔
November 9, 2025 at 1:27 PM
for instance, LLM inference systems like vLLM often leverage collective communication (e.g. NCCL), and once a cluster is established, its topology remains unchanged. in Kubernetes, a LWS (Leader Worker Set) is particularly well-suited for this type of workload. 🤔
November 9, 2025 at 1:23 PM
when scaling is required, one simply continues to add fixed-size clusters to the system, and put some load balacing in front of multiple clusters.
November 9, 2025 at 1:21 PM
the truth has been spoken, the people who can fund the housework robots don't have to do the dishes themselves 😂
November 9, 2025 at 1:18 AM
if robots could handle these logistical tasks, a significant portion of housework would already be freed up. the form of the robot, whether humanoid or not, probably isn't that important. 🤔
November 8, 2025 at 3:13 PM