hicder.bsky.social
@hicder.bsky.social
Reposted
Two years ago I wrote about how a few major source-available databases execute expressions.

Many (most?) of them still operate as AST-walking interpreters! Some compile to virtual machine instructions they then interpret. Few JIT.

notes.eatonphil.com/2023-09-21-h...
March 21, 2025 at 1:55 PM
Reposted
The gap between database wire protocols (designed 30 years ago) and modern dataframe libraries (designed for emerging ML/data science workloads) causes huge inefficiencies.

This paper presents a solid exploration of client and database co-design. www.vldb.org/pvldb/vol15/...
March 17, 2025 at 4:28 PM
I built a vector database from scratch in Rust! github.com/hicder/muopdb

Why? Just to learn vector database and Rust :D Right now it supports HNSW, IVF, PQ, L2 distance with SIMD. Aggregator-leaf architecture with separate index_writer binary.

Not production-ready (yet).
GitHub - hicder/muopdb: MuopDB - A Vector Database
MuopDB - A Vector Database. Contribute to hicder/muopdb development by creating an account on GitHub.
github.com
November 20, 2024 at 6:27 PM