Interest | Match | Feed
Storing data in object storage, while using a WAL to keep latencies low. etcd is used for metadata storage. Uses Opendal to write to different object storages.
Storing data in object storage, while using a WAL to keep latencies low. etcd is used for metadata storage. Uses Opendal to write to different object storages.
For a quick test I created a 1GB csv file, sorted it by a field and then created a second file to to store the offsets for each starting letter (i.e. A => 56, B =< 242384, etc). (1/4)
For a quick test I created a 1GB csv file, sorted it by a field and then created a second file to to store the offsets for each starting letter (i.e. A => 56, B =< 242384, etc). (1/4)
this allows users to leverage the out-of-box primitives from the OpenDAL operator, such as chunking / parallel fetching and caching on user-provided object_store instances
github.com/apache/opend...
this allows users to leverage the out-of-box primitives from the OpenDAL operator, such as chunking / parallel fetching and caching on user-provided object_store instances
github.com/apache/opend...
Post: xuanwo.io/links/2025/0...
Repo: github.com/Xuanwo/mcp-s...
Post: xuanwo.io/links/2025/0...
Repo: github.com/Xuanwo/mcp-s...
https://github.com/apache/opendal
https://github.com/apache/opendal
Supports filesystem, cloud storage etc. written in Rust
Node package:
github.com/apache/opend...
Supports filesystem, cloud storage etc. written in Rust
Node package:
github.com/apache/opend...