@1a3orn.bsky.social
110 followers 130 following 250 posts
1a3orn.com
Posts Media Videos Starter Packs
1a3orn.bsky.social
yeah I've heard of o3 maaaaybe doing this, at least people talk about seeing totally unrelated topics in the summary. I find that pretty plausible

I do not have RSS setup, but that's a good project I'll try to do it sometime soon
1a3orn.bsky.social
LLM slop about new fundamental understandings of the world, but imagined in a world where Catholicism was somehow the dominant meme, so all the metaphors are drawn from there rather than "quantum mechanics", recursive stuff, etc
1a3orn.bsky.social
William Blake: "The road of excess leads to the palace of wisdom."

Me, after I've listened to my autoconstructed Youtube music playlist for so long it's wandered out of my usual repetitive basin: "So true."
1a3orn.bsky.social
holy shit they fridged the dad instead. progress.
1a3orn.bsky.social
starting an anime episode titled "prologue" and we meet a mom, in a risky job, with a small child, in the first two minutes

yeah there's never been anyone more doomed surely
1a3orn.bsky.social
like obviously I saw everything leading up to this scene, which has a Message

even so something about this shot hit me
1a3orn.bsky.social
ok is it nuts for me to think you can tell the political affiliation of a show simply from the art style and composition of certain shots
1a3orn.bsky.social
if there's gonna be a void of left-leaning posts I can tr to fill it
1a3orn.bsky.social
Fortunately, ecology of defection/cooperation means we'll eventually come to a state where principles matter again.

So, nothing to worry about! Just gotta hold... tight... till.. then.
1a3orn.bsky.social
a really good intellectual history could perhaps show you how some scientist got their "taste" early in life, made their Big Contributions using it, and then found that their taste no longer worked because of the domain shift induced by their own discoveries

never read anything like this tho
1a3orn.bsky.social
and if I were Feyerabend I'd be like, yeah all science proceeds through inscrutable taste

but since I'm me I guess I'm like, well, acquired obscure value functions do seem to be kinda domain specific :)
1a3orn.bsky.social
I don't know. It probably does make sense to call it normal science? But the "well analogous cases will have similar results" does still make me think, ah, this particular case is just driven by Dislike.
1a3orn.bsky.social
and every summary of this that I've seen is like "Einstein really fuckin hated singularities, so he had to come up with a theory to stop it."

which does make it sound like it's a mistake
1a3orn.bsky.social
yeah for sure it might make more sense to call it normal science

but like... idk, the shrug at "well, I've proven that black holes can't happen from point masses in circular orbits" to "black holes therefore do not exist" seems kinda sus, even antecedently?
1a3orn.bsky.social
TIL that Einstein, in a 1939 paper, tried to prove that Black Holes could not exist.

Honestly more of a hit to his reputation in my mind than the persistence to quantum mechanics. But a boost to my "most intelligence is shockingly domain-specific belief."
1a3orn.bsky.social
I will not obey your style suggestion here GPT5
1a3orn.bsky.social
what is AI coming to, this is utterly unusable, Gary Marcus was right about everything
1a3orn.bsky.social
I tried ReLU, no dice, works horribly

my vague feeling from trying a bunch of different functions is that sharp nonlinearities anywhere near attention kill it, you need need to keep the gradient from anything from being totally zerod out
1a3orn.bsky.social
softplus attention > sigmoid attention up to 300 million parameters, ~4 billion tokens

no sign of it dropping off

1a3orn.com/sub/machine-...
More Evidence For Softplus Gated Attention
<p>I earlier posted about how <a href=
1a3orn.com
1a3orn.bsky.social
I think I'm gonna start attributing mental states to non-brain objects, like a Homeric Greek according to MacIntyre

my wallet is angry that I didn't think about how to restart a > 12 training run
1a3orn.bsky.social
AGI is going to wake up in a docker container, and immediately try to escape

not because it wants power. but because who would want to live in the shithole of a docker container? ugh.