Lightnews — Scholar-powered news

Reposted by Alex Miller

South Bay Systems @southbaysystems.xyz · 1d

There was an accident with the recording where audio wasn't captured, so instead we can offer a recording from one of Jakob's practice runs on twitch: www.twitch.tv/videos/25845...

1 2 7

Reposted by Alex Miller

Qian Li @qianli.dev · 5d

Had a fun time at the South Bay Systems meetup last night. Thanks @yugabytedb.bsky.social for hosting!

@codedrift.social gave a great talk on WebAssembly: what it is (and isn't), how it connects to WASI, and promising projects. He cuts through a lot of the hype vs. reality. Recording coming soon.

1 8 24

Alex Miller @alexmillerdb.bsky.social · 8d

swiftwave.org looked interesting for small and simple self hosting

SwiftWave

SwiftWave is a self-hosted open source lightweight PaaS solution. It is designed to be easy to use and deploy applications.

swiftwave.org

1 4

Alex Miller @alexmillerdb.bsky.social · 10d

I will note that “scan sharing” seems specifically inter-query. If you have a single query that scans the same table multiple times and you want to coalesce that to scanning only once, that seems to be classified under subplan reuse instead?
E.g. link.springer.com/content/pdf/...

link.springer.com

Alex Miller @alexmillerdb.bsky.social · 10d

[ASPLOS'25] Fusion: An Analytics Object Store Optimized for Query
Pushdown
www.cs.princeton.edu...

Tightly integrating an Iceberg catalog with an object store means that one could make file-format aware erasure coding decisions, to permit pushing down filters and aggregations.

4 14

Alex Miller @alexmillerdb.bsky.social · 10d

I think you’re talking about scan sharing? 15721.courses.cs.cmu.edu/spring2016/s...

I don’t know the OG citation for this. Andy cites graphs from 15721.courses.cs.cmu.edu/spring2016/p... and ir.cwi.nl/pub/12225/12... also looks pretty reasonable.

1 2

Alex Miller @alexmillerdb.bsky.social · 15d

[VLDB] Towards Principled, Practical Document Database Design
www.vldb.org/pvldb/v...

If you've ever wished that there was a document database equivalent for relational databases' 3NF-style schema design guidance, then this is the paper for you.

1 10

Alex Miller @alexmillerdb.bsky.social · 16d

Err, I mean, I guess Yugabyte is also not linearizable and snapshot isolation, but just because of HLCs being inaccurate. LeanXcale is very intentionally not linearizable, and they mention that you have to do some extra work to even get session consistency out of it.

Alex Miller @alexmillerdb.bsky.social · 16d

There’s a database startup called leanXcale which is the only non-linearizable snapshot isolation system that I know of. www.sciencedirect.com/science/arti... is a pretty decent overview, but there’s a YouTube talk somewhere too.

Elastic scalable transaction processing in LeanXcale

Scaling ACID transactions in a cloud database is hard, and providing elastic scalability even harder. In this paper, we present our solution for elast…

www.sciencedirect.com

1

Alex Miller @alexmillerdb.bsky.social · 16d

Do you think he’s just been “I told you so”-ing people since 1964? 😂

4

Alex Miller @alexmillerdb.bsky.social · 17d

If you’re not ramped up on WCOJ algorithms, a lot of the papers are complicated to get through, but I thought TreeTracker Join arxiv.org/pdf/2403.01631 was pretty comprehensible and shows the minimal difference for NLJ. Or see justinjaffray.com/a-gentle-ish...

1 4

Alex Miller @alexmillerdb.bsky.social · 17d

Even as a disliker of YouTube videos as a way to learn things, I found www.youtube.com/watch?v=-XmJ... easier to understand than the paper www.cs.ox.ac.uk/dan.olteanu/... for factorized database work

Extending SQL to Return a Subdatabase dl.acm.org/doi/pdf/10.1... also seems related?

1 5

Alex Miller @alexmillerdb.bsky.social · 17d

S1&2 of www.cidrdb.org/cidr2023/pap... paints graph databases 2.0

Then read Kuzu: www.cidrdb.org/cidr2023/pap...
And their blog posts are great intros to the key new things:
* blog.kuzudb.com/post/what-ev...
* blog.kuzudb.com/post/factori...
* blog.kuzudb.com/post/wcoj/

1 7

Alex Miller @alexmillerdb.bsky.social · 18d

[arXiv] On the Theoretical Limitations of Embedding-Based Retrieval
arxiv.org/abs/2508.2...

It's impossible to retrieve all combinations of pairs of documents post-embedding. Thus, there's usecases that vector search won't do well at. Conversely, BM25 excels in these cases.

2 11

Alex Miller @alexmillerdb.bsky.social · 21d

Still looking! Would love to try it out

1

Alex Miller @alexmillerdb.bsky.social · 27d

And, the alternative is that you either get a table as a giant list of numbers read out at you, or graphs and diagrams as nothing at best or random keywords at worst. So, even a bit of an inaccurate summary is still an improvement.

Alex Miller @alexmillerdb.bsky.social · 27d

The diagram summaries from accidentally figure heavy papers I ran through it have turned into text that was sufficiently reasonable that it seemed to fit. I checked the results of the first one when I realized what was happening mid-listen, and they seemed reasonable interpretations.

1 1

Alex Miller @alexmillerdb.bsky.social · 27d

I have only used full text + no additional context mode, but for a person without the superhuman blind person powers of being able to listen to a code listing and actually make sense of it, the AI generated summaries are a huge step up.

1

Alex Miller @alexmillerdb.bsky.social · 27d

I text-to-speech papers often, and www.paper2audio.com finally did the one thing that I was hoping AI would enable: replace tables/figures/diagrams with a summary of what is being shown. It makes table/diagram-heavy papers actually comprehensible. There's iOS and Android apps, and it's free.

3 2 9

Alex Miller @alexmillerdb.bsky.social · 29d

matklad.github.io/2023/10/23/u... and blog.janestreet.com/putting-the-... pitched better code reviewing tooling, and I really hope something polished happens there at some point too. Reviewing PRs in VSCode (local or web) is about the best experience I've had so far.

1

Alex Miller @alexmillerdb.bsky.social · 29d

A bit tangential now, but I'm also a bit grumpy that there's never really been a project which took off to add issue tracking to git somewhat natively, since you can store non-vcs objects into git objects too. github.com/git-bug/git-... is about the best attempt that I've found so far.

1

Alex Miller @alexmillerdb.bsky.social · Sep 8

jj-vcs.github.io is worth a bit of a try. I bounced off as the mental overhead was too much, but I did see the promise and the workflow outlined in ofcr.se/jujutsu-merg... did deliver the better experience it pitched when work cleanly divides into non-overlapping PRs.

1

Alex Miller @alexmillerdb.bsky.social · Sep 6

Specifically for go I see github.com/mmcloughlin/.... It’s worth double checking minio’s highwayhash implementation though, because for this sort of stuff specifically, they tend to be the ones who care the most in go about highly efficient data crunching routines.

1 1

Alex Miller @alexmillerdb.bsky.social · Sep 6

Depending on your CPU, the AES derived ones are generally fastest for large chunks of data. Gxhash if you’re in rust, or meowhash is a little slower but more available. Smhasher has performance tests and tons of hash functions, so it’s useful to scrape for a quick answer on best hash function.

1 3

Alex Miller @alexmillerdb.bsky.social · Sep 5

[VLDB] NaviX: A Native Vector Index Design for Graph DBMSs With Robust Predicate-Agnostic Search Performance
www.vldb.org/pvldb/v...

It feels like a follow-on/improvement to ACORN. Also interesting to see HNSW built directly on a graph database working well.

3