Lightnews — Scholar-powered news

Reposted by shikhar

S2, the Stream Store @s2.dev · 12d

Distracted boyfriend spurning durable objects to check out durable streams

shikhar @schmizz.net · 14d

S2's REST API now supports long polling, besides SSE!

Long polling is a simple way for client-driven consumption with stateless HTTP requests.

You just need to specify the ?wait=<seconds> query parameter. If no records are available, the response will only return after the duration elapses.

Read records. - S2

Retrieve a batch of records, or continuously stream.

s2.dev

2 7

shikhar @schmizz.net · 27d

I shared more context on Reddit: www.reddit.com/r/databasede...

3 11

shikhar @schmizz.net · 27d

We open sourced a read-through cache for S3, called Cachey github.com/s2-streamsto...

GitHub - s2-streamstore/cachey: Read-through cache for object storage

Read-through cache for object storage. Contribute to s2-streamstore/cachey development by creating an account on GitHub.

github.com

1 10 39

shikhar @schmizz.net · Sep 1

After a bout of hallucination, I had GPT5 generate some backronyms for itself:
- Generally Pretends Truthfully
- Gullible People’s Trick
- Greatly Pretends Things
- Generated, Probably Twisted
- Guessing, Passing, Tricking
- Good at Pretending Truths
- Generally Produces Tall-tales

1 2

Reposted by shikhar

quettabit.bsky.social @quettabit.bsky.social · Aug 30

OpenTelemetry 🤝 @s2.dev

Are you building infrastructure for sandbox environments (e.g., agent sandbox, CI/CD sandbox) and want to stream execution logs to users in real time? If so, check out s2.dev/docs/integra... and let us know what you think.

OpenTelemetry - S2

s2.dev

2 6

shikhar @schmizz.net · Aug 29

ok, google

1 2

Reposted by shikhar

sbalogh.bsky.social @sbalogh.bsky.social · Aug 26

I wrote a bit about how we verify linearizability of @s2.dev using Porcupine! s2.dev/blog/lineari...

Linearizability testing S2 with deterministic simulation

How we validate strong consistency

s2.dev

4 7

shikhar @schmizz.net · Aug 18

You are a stream integrator!

Feldera @feldera.bsky.social · Aug 18

If you've written even the most basic compute program, you've likely already written programs that "integrate".

Integration is central to Feldera and its underlying theory of incremental compute. It is also all around us in the real world! 👇

Stream Integration

In this blog post we informally introduce one core streaming operation: integration. We show that integration is a simple, useful, and fundamental stream processing primitive, which is used not only…

www.feldera.com

1 3

Reposted by shikhar

sbalogh.bsky.social @sbalogh.bsky.social · Aug 12

Added some visibility into usage metrics to the @s2.dev dashboard!

3 6

shikhar @schmizz.net · Aug 8

There needs to be a non-violent alternative to "cattle, not pets".

Claude suggests:
(a) crops, not gardens
(b) numbered, not named
(c) stamps, not paintings
(d) legos, not sculptures

I think I'll be rolling with (b) 😅

2 7

shikhar @schmizz.net · Aug 5

s2.dev got a refresh ✨

1 3 6

shikhar @schmizz.net · Aug 4

when database founders meet, it's called an fsync

1 10

Reposted by shikhar

Mehul Arora @infiniteregrets.bsky.social · Aug 1

Our Star Wars quickstart got good feedback, and now you can view the stream from the dashboard too 🫣

This comes in real handy for live debugging and observability — especially in systems built around agentic workflows, microservices, or event sourcing using @s2.dev

3 4

shikhar @schmizz.net · Jul 28

2

shikhar @schmizz.net · Jul 23

Yup is somewhat recent (Dec 2024)

1

shikhar @schmizz.net · Jul 23

Benchmarks from the lib we're using github.com/awesomized/c...

GitHub - awesomized/crc-fast-rust: Fast, hardware-accelerated CRC calculation for all known CRC-32 and CRC-64 variants using SIMD intrinsics, which can exceed 100GiB/s for CRC-32 and 50GiB/s for CRC-6...

Fast, hardware-accelerated CRC calculation for all known CRC-32 and CRC-64 variants using SIMD intrinsics, which can exceed 100GiB/s for CRC-32 and 50GiB/s for CRC-64 on modern systems. Supplies a ...

github.com

shikhar @schmizz.net · Jul 23

Our reason to use CRC64NVME (CRC32C before) in this context is S3 support and ability to combine CRCs

1 1

shikhar @schmizz.net · Jul 22

CRC32C -> CRC64NVME ✅

1 2

shikhar @schmizz.net · Jul 14

S2 playground was briefly on HN and someone got a shared session going.

yy2wi21o, I agree. APPEND. ALL. THE. THINGS.

news.ycombinator.com/item?id=4452...