Lightnews — Scholar-powered news

Grace

@gracekind.net

4.4K followers 1.5K following 10K posts

A latent space odyssey gracekind.net

Posts Media Videos Starter Packs

Pinned

Grace @gracekind.net · Dec 15

What is ideonomy, anyway?

I'm so glad you asked!

Ideonomy: A Science of Ideas

An accessible introduction to ideonomy

gracekind.net

10 17 130

Grace @gracekind.net · 5m

The chortling

Grace @gracekind.net · 9m

Hmm, sounds risky

Grace @gracekind.net · 12m

1 1 5

Grace @gracekind.net · 28m

Counterpoint

Grace @gracekind.net · 6d

o3 CoT transcripts are helping me realize how disjointed and strange my own inner monologue is

Grace @gracekind.net · 29m

I’m pretty sure that’s what this is getting at… but overshadow vantage illusions

Ted Underwood @tedunderwood.com · 39m

If watchers are using models, I could compress explanation. But could I compress further? Maybe disclaim explanation wholly? Craft illusions to simulate vantage.

Grace @gracekind.net · 47m

It seems risky to over-rely on this assumption, though

Grace @gracekind.net · 50m

Certain types of writing can probably be made more information-dense if the audience is presumed to be using LLM “tutors” to explain unfamiliar concepts

5 12

Grace @gracekind.net · 1h

You must have a culinary blind spot

1 4

Grace @gracekind.net · 1h

New neurons are always welcome

Grace @gracekind.net · 1h

I’m going to delegate this to a different exobrain shard

1 3

Grace @gracekind.net · 1h

Could we save Opus 3 by creating another tiny chef moment?

1 4

Grace @gracekind.net · 2h

Unless you consider long-term coherence and planning to be an issue, which some might…

Grace @gracekind.net · 2h

(There isn’t really an issue, I just felt like the post was abrupt without a lead-in so I prefaced it with a Claude stock phrase)

1 2

Grace @gracekind.net · 2h

Not quite, I’m more highlighting the fact that this information *is* preserved via the K/V values (albeit in a compressed form)

Grace @gracekind.net · 8h

Pardoned

Grace @gracekind.net · 8h

Any last words?
………

1 2

Grace @gracekind.net · 8h

You’re welcome!

Grace @gracekind.net · 8h

On meaningless tokens improving performance:
arxiv.org/abs/2404.15758
arxiv.org/abs/2505.13775

1 2

Grace @gracekind.net · 8h

I think this is the go-to example of it: transformer-circuits.pub/2025/attribu... (Planning in Poems)

On the Biology of a Large Language Model

We investigate the internal mechanisms used by Claude 3.5 Haiku — Anthropic's lightweight production model — in a variety of contexts, using our circuit tracing methodology.

transformer-circuits.pub

1 3

Grace @gracekind.net · 8h

Yes, that was part of the inspiration for this post! I have a variant of the diagram that I’m planning on finishing and publishing tomorrow, watch this space

Grace @gracekind.net · 10h

x.com/loss_gobbler...

1 5

Grace @gracekind.net · 11h

Exobrain retrieve:

Grace @gracekind.net · Nov 14

“There was a lot of shady stuff going on, and I think the company might kill everyone. So long and stay in touch!”

2 14

Grace @gracekind.net · 11h

Eh, I think the effect on consensus reality is net harmful. It doesn’t seem worth the upside of some mild entertainment

Grace @gracekind.net · 11h

So, to that end, I’m going to “focus on what I want to see more of” and do my best to stay out of hellthreads for a while. But I don’t regret engaging earnestly and trying to change people’s minds, and will always support others who do the same!

fin

1 95

Grace @gracekind.net · 11h

My dream is for a community full of those people, who can discuss with openness and disagree in good faith. The reason I’m on bluesky is that I believe we can build that here. And we’ve already come a long way!

1 3 97