Lightnews — Scholar-powered news

Yaroslav Tkachenko @sap1ens.com · 1d

a woman wearing a gold top and earrings is sitting in front of a blue background .

ALT: a woman wearing a gold top and earrings is sitting in front of a blue background .

media.tenor.com

1

Yaroslav Tkachenko @sap1ens.com · 3d

At Polyglot Vancouver

1

Yaroslav Tkachenko @sap1ens.com · 5d

I'll be at the Flink Forward in Barcelona next week. Happy to talk about all things data streaming, Flink, Arrow, DataFusion and more. You can also get these cute stickers! 🐿️

1 4

Yaroslav Tkachenko @sap1ens.com · 8d

One of my superpowers: actually watching conference talk recordings 🤓

1 9

Yaroslav Tkachenko @sap1ens.com · 9d

I agree with everything in the post and I tried my best to follow these practices. But, in my experience, bad politics often win. And when that happens several times, you don't want to be involved at all...

Matheus Lima @terriblesoftware.org · 13d

Politics isn't manipulation and backstabbing. It's understanding how decisions actually get made and learning to navigate that reality.

Refusing to engage doesn't make politics go away. It just means you lose by default.

terriblesoftware.org/2025/10/01/s...

Stop Avoiding Politics

Most engineers think workplace politics is dirty. They’re wrong. Refusing to play politics doesn’t make you noble; it makes you ineffective.

terriblesoftware.org

3

Yaroslav Tkachenko @sap1ens.com · 11d

or Akka

1

Yaroslav Tkachenko @sap1ens.com · 15d

Arroyo powers Cloudflare Pipelines. R2 SQL is a separate project (but also leverages DataFusion).

2 1

Yaroslav Tkachenko @sap1ens.com · 22d

Today, in the Data Streaming Journey, I'm sharing my experience of building data streaming products with the RAD stack: Rust, Arrow, DataFusion.

www.streamingdata.tech/p/streaming-...

Streaming and the RAD Stack

RAD: Rust, Arrow, DataFusion

www.streamingdata.tech

1 9

Yaroslav Tkachenko @sap1ens.com · 26d

Really, Grammarly?

1

Reposted by Yaroslav Tkachenko

Yaroslav Tkachenko @sap1ens.com · 29d

Introducing Iron Vector: native, columnar, vectorized, high-performance accelerator for Apache Flink SQL and Table API built on top of Rust, Arrow and DataFusion.

Reduce your Flink compute cost by up to 2x or handle 2x more data with the same infrastructure.

1 5 17

Yaroslav Tkachenko @sap1ens.com · 29d

Learn to give and don't expect anything in return.

Yaroslav Tkachenko @sap1ens.com · 29d

Read the announcement post for more details: irontools.dev/blog/introdu...

Introducing Iron Vector: Apache Flink Accelerator Capable of Reducing Compute Cost by up to 2x

Iron Vector is a native, columnar, vectorized, high-performance accelerator for Apache Flink SQL and Table API pipelines. It’s easy to install, requires no code changes, and can increase compute effic...

irontools.dev

2

Yaroslav Tkachenko @sap1ens.com · 29d

Introducing Iron Vector: native, columnar, vectorized, high-performance accelerator for Apache Flink SQL and Table API built on top of Rust, Arrow and DataFusion.

Reduce your Flink compute cost by up to 2x or handle 2x more data with the same infrastructure.

1 5 17

Yaroslav Tkachenko @sap1ens.com · Sep 12

a man in a suit and tie is standing in front of a rack of ties

ALT: a man in a suit and tie is standing in front of a rack of ties

media.tenor.com

Yaroslav Tkachenko @sap1ens.com · Sep 11

I wrote a clickbait-y post a few years ago titled like this :) Not sure if Ryanne agrees with me

www.streamingdata.tech/p/change-dat...

Change Data Capture Is Still an Anti-pattern. And You Still Should Use It.

The transactional outbox pattern is too good to be ignored.

www.streamingdata.tech

4

Yaroslav Tkachenko @sap1ens.com · Sep 10

Very unexpected pivot. Is there an official post?

1

Yaroslav Tkachenko @sap1ens.com · Sep 9

Yeah, but what else do you need nowadays? 😜

1

Yaroslav Tkachenko @sap1ens.com · Sep 9

It looks like github.com/supabase/etl is the answer!

GitHub - supabase/etl: Stream your Postgres data anywhere in real-time. Simple Rust building blocks for change data capture (CDC) pipelines.

Stream your Postgres data anywhere in real-time. Simple Rust building blocks for change data capture (CDC) pipelines. - supabase/etl

github.com

1 3

Yaroslav Tkachenko @sap1ens.com · Sep 9

The benefit of working two jobs: when you're tired of one, you can switch to another.

a close up of a man 's face with a mustache wearing a black jacket .

ALT: a close up of a man 's face with a mustache wearing a black jacket .

media.tenor.com

4

Yaroslav Tkachenko @sap1ens.com · Sep 7

This is too good not to share: www.scattered-thoughts.net/writing/sql-...

SQL needed structure

www.scattered-thoughts.net

1 6

Yaroslav Tkachenko @sap1ens.com · Sep 4

You're not alone :) Kent Beck has been using the genie analogy for a while, e.g. tidyfirst.substack.com/p/augmented-...

Augmented Coding & Design

The Genie Eats The Seed Corn

tidyfirst.substack.com

1 1

Yaroslav Tkachenko @sap1ens.com · Sep 2

I was compelled to make this

2

Yaroslav Tkachenko @sap1ens.com · Aug 31

tbh, all of these are trivial to fix. I may even open some PRs...

Yaroslav Tkachenko @sap1ens.com · Aug 31

arrow-avro: I'm an experimental library!
me: ok, not a big deal
me, three days later: oh, I see 😬

1 3

Yaroslav Tkachenko @sap1ens.com · Aug 29

The ability to keep up with DataFusion upgrades is a skill. The project truly leverages "breaking changes are fine in a major version upgrade" rule. Just look at this: datafusion.apache.org/library-user... 😅

3 3